( 

ID |57 033 

&QTBOB 
TITLE 



DOCQHBHT BBSIHB 



CS 004 244 



IHSTlTOTION ' 
SPONS . AGEHCY 



POB DATE 
CONIEACT 
NOTE . 



EDBS PRldE 
DESCBIPTOfiS 



Pfixritt, Lea J.; 'Hertens, Ecnna M. • • 

SuBBative Evaluation of Diagnostic and Prescriptive v.' 
^eadirig instruction^ Spfing, 1-977 .and Career 
Education in the "Elerehtary Schoolr' Sn'oBer, 1977. 
• Technical Rj^port NUBber 17. » . " • v - «' • 

. ^Appalachian Education Satellite Project', lexingt6n» 
" 'Ky. . ' ■. ■ ■ • 

Appalachian Regional CCBBission, Washington, b.C; 
National Inst, of Education (DBipj) , Washington,. 
- D.C. . ■ . ■ ' ' ■ 

Nov 77 . 

76-l6tf'cO-3b09A; 76-C2-0i-02 26 . ^ • , 

lllp.;' Sone part's cf appeiidix -are of marginal print 
: quality - " ' ' ^ 

llF-$0.83 HC- $6.01* Plus Postager k 
♦Career Eplucation^i Course rescript ionst *Course 
. Evaluation; ♦Diagnostic Teaching} *Educational 

' Television ; .Elementary Secondary Educa-ti6n;f 
' Evaluation Methods; Higher Education; Heasureaent' 
In'struiients; Questionnaires; ♦Beading Instruction';' 
♦Teacher Education ^ , ' ' ' - 

♦appalachia 

' ^nce 197a the Appalachian Education Satellite 
Program, which is described in tfcis report, has delivered gra^duate 
level teacher training courses in diagnostic and -t^rescriptive reading 
and in career education to eleientary and secondary teachers in 
reaote areas of Appalachia. Evaluation of the courses has focused on. 
determining how they affected participants* learning and attitudes, 
the effectiveness* of the learning activities and aethcds cf 
presentation, the reliability^ of .the equipment, the overall course 
evaluations, and the way the results'^ccapare with ithe results of 
previous^ deliveries of the . course. , This report presents the results 
of tHe/^977 deliveries of" the . two types ^of courses to eleientary 
teJichers. * For each course, it provides a course overview and lists 
topics and objectives for the in^vidual programs in the course, . 
discu;^es pfoce^ures and instruments used ^n the course evalaution, . 
and pres^ents thief evaluat^ion result?. The rep.ort iiicjludes numerous 
tables *and provides iSaaples of :^ch aate'tials as attitude and 
background questionnaires, instructional activities rating fpras^^and 
oquipaent report and student satis fact ion.* forms coapleted by W 
teachers. -(GH^ , ' ♦ , ^ 



IDE»yiFIERS 



ABSTRACT 



i 



♦ fieprod«:tions supplied -by EDBS a^e /tbe Sest 'that^can be iad^e- ♦ 

♦ ' / *. ' from the original docuaent. ♦ 
^^^^^^^^^^^^(♦♦♦♦♦♦♦♦♦♦'♦♦♦♦^♦♦♦♦♦♦♦^♦♦♦♦♦♦♦♦♦♦^♦♦♦♦♦♦♦♦♦^♦♦♦♦♦♦♦♦♦♦♦♦^♦^ 



o 



us DEPARTMENT OF HEALTH, 
EOUCATION* WELFARE 
. Ni^TtONALIHSTtTUTCOF 
COUCATION 

THIS DOCUMENT HA^ BEEN ^EPfl^O• 
DUCED EXACTLY AS RECEIVED F^OM 
THE PERSON OR ORGANIZATION ORIGIN. 
ATING IT P6INTS OF VIEW OR OPtNlOt^S 
STAiTED DO NOT NECESSARILY yREPRE- 
SENT O^FICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POUCY 




/ i 



SUMMATIVE EVALUATION OF 



• DIAGNOSTIC AND PRESCRIPTIVE READING INSTRUCTION, SPRING, 1977 

» AND 

• . • • • 

CAREER EDUCATION IN THE ELEMENTARY SCHOOL, SUWER, 1977 



/ 



Techn/ical Report No- 17 




-Prepared by , 
, Lea 0. Pefritt- ' 

. 'and 
, Donna M.-,Mertens. 

* 

♦ 

* November, 1977 

/ 



I r 



The Technical Report Series. of the Appal acKi an Education SatellUe ' 



Project is edited and published by the RCC Evaluation Component at the 

\ 

'University of Kentucky, Lexington, Kentucky. . - - • 



/ 



The purpose of .this- series is to docimient ^nd disseminate information 
about the design, iypi mentation and results, of the AESP experiment. 



ACKNOWLEDGEMENTS 



'AE$P»ARC Personnel 



Harold^ Moise, director of AESP . * 

Dennis/Stdstein, Ass.ociate Dlrfectof of AESP ■ 
Robert Shirnan , ' Deputy Dijrector of AESP 
'Oames Freeman, Chief ER§ineer ' 
Jerry Goerz, Engineer 

Dave Buckingham, Regional Site Coordinator - 
.Gail. Schlenker, Regional Site Coordinator 

AESP-RCC Personnel ■ " ' ' • • " 

Nofflet Williams, director of RCC ' " ' 

Cathy Hensl-ey, Coordinator of F.ield Services , ' 

Donna Mertens, Coordinator of Evaluation • ■ ' 

Jody Fitzpatrick, Research Associate • ^ 

Lea Perrittw EValuator 

Melissa Etiin, Materials Developer . ^ ' . 

Dan! 0 Kao,". Data Analyst ■ •. • ' ' 

Lloyd Lowry, D«ita Analyst ' . ' " ' . - 

Bos6mary Waters, Senior Administrative Assistant • •» 

Debby Kahoe, Clerical Assistant . • ■ • 

Gayle Abeggl en, iFi eld Servicjs Secretary 

Marianne Truong, -'Evaluation Secretary • " \ 

Roger Koonce, Associate Director for Instructional Design and Production 

Rick Falknor, Assistant Media Services* Coordinator ' ' 

Britt^Davis, Producer-Director 

Paul LeVeque, Producer-Diretjtor. ' - 

Jerry McDonald, Prod'tjcer-Di rector ' 

\ ' ■ ■ ■• ■-- ' . ■■' • . 

AESP Cluster Directors 

.Jerry Ayers, Tennessee, .' ' ' 
Alice Beckraan, New York and Terinessee v 
Douglas Cross, Tennessee . ^ 

Alan Hyatt, Alabamla ... ■ ^ - ^ 

djjwley Jones, Virginia and North Carolina • . . 

Frank Peto, Maryland - West Virginia antl Pennsylvania 
Don Smith, Alabama and Georgia - / ■ , . . • 

Rick wniiamstfh. West Virginia arid. Pennsylvania 
Kathryn Zachary, North Carolina and Georgia 



t4 



" . ' ^ TECHNICAL REPORT SERIES • " ' 

. ■.. • ■ ^ • • • '. 

1. AESP Data Base Infortnation; Rationale. Data Coll ec'ti on PrQi::Bdure . 
• ■ , ,• . Interpretation of Results . ^Prepared by Wmiam J. Brambler 
, ■ tlaudine Ausness, Lafry Harding and .Robert Wetter. - Winter 1973 

* t Z\ . An -Experiment in Educatiotfal 'Technology; An Overvfew of the 

Appalachian. Education Satellite Project" ! Prepared by CI audi ne " 
Ausness and Betty Botfling. March, 1974. ^ • • 

3. Formative EvaluaHdn Study for AfSP "Pf agnostic' and PrescrTptive ^ ^ 
Reading Courses ; Prepared by Will iam ,J. Bramble, Claudine 
X Ausness and Ro,bert Wetter. October, 1974. 

•4. 'Th§. Evaluation Design; Summer Courses, 1974 . Prepared by 
wiijusm J. bramble, Claudine Ausness, Robert Wetter and 
Larry Harding. December, 1974. • 

5. Penforman c e of AESP- Transmission/Reception Equipment (Suimier and 
' Fall. 1974) . Prepared by William J. Bramble, Claudine Ausness 
and James R. Freeman. -July, >975. . . , - 

' 6. Student Ratings of InstructionaLActivitiesf Jiabrojstic gnd 
Prescriptive Heading instruction. Summer, Preparect • 

Dy Kodger Marion, Wiinam J. Bramble, Kobert Wetter and* Cathy 
Whitton, July, 1975. . • 

* • • ] 
1 . Student Ratings of Instructional Activities: Career Education in 

tne tiementary iiraQes> bumnier> ii^/4 > Prepared by Larry Harding, 

, Wiinam J, bramore and Kpdger Manon.^j|ugust, IQyB". ^ ' 



8^ . Student Achieve>nent; Diagnostic and^escriptiye Reading Instruction 
JUOurge> burrmer^ 1^7^ Prepared by Kodger Man on, wiinam J. braniDie 
and uiaudme Ausness/' August, 1975.^ ^ . 

9. Student Achievement^^ .Ciareer Education in the Elementary Grad es, 
buitmier, Prepared by Kodger Ha ri on, VQ I nam > J. bretmwe- 

and Claudine .Ausness. August » 1975. . , 

10. Co^t Estimation Model for Alternative Course Formats an^ Delivery 
^ Modes > i(t Prepared by vnmatn J^ brambie; ciaudme Ausness, and 

*Uonna Mertens. - S^tember, .1975.. ^ / 

. ^ ' ' *! " ' ^* • 

11. Summative Evaluation of CaVeer Education in the Secondary School 
- Course^ FalK 1974 . -Prepared by Diane Maynard, Rodger Marion and 
^ William J. Bramble. Sep\^ber, •1975. ^ . - 

12. Summative Evaluation of Diagnostic and Prescriptive^ Reading 
Instruction Course^ Sprindt 1975. Prepared by William . 

Bramble> Diane Maynard ^nd p.o'dger Marion. September, 1.975. 



ERIC , . < 



, TECHNICAL REPORt SERIES 



* * * ' 

' 13*. Review of the LiWature; Appalachian Needfe in Five Progranwing Areas . 
*. .Prepared by Donna M. Mertens and WilMara i3. Bramble. June, 1976. 

• * 

14. Results of Appalachian Needs Assessment Conferences^ Pj-epared by Donna 
\. M. Mqrterfs and >William J. Bramble. June, 1976. ~ •* 

15. DPRI'and C'ES Fol low-Up Studied. Prepared by,Jody L.' Fitzpa trick arid 
Qonna M." Mertens. July 1977*.- ■ . : , 

15. D evelopment, Delivery ajid, Evaluation of-AESP's Visual Learrting Course. ~ 
Prepared by Donna M. Mertens. August 1.977. 

.17. Summative Evaluation of Diagnostic and Prescriptive Reading Instruction 
K -6 Course, Spring, 1977, and Career Education U the Elenentary School 
Course,. Summer, 1977 . Prepared by, Lea J.Perritt'and Donna M. Mertens. 
November, 1977. 

* • • 

18. Sufrmati^e Evaluati-on. of Workshops, Summer,. 1977. Prepared 'by Lea J. 
Perritt and Donna M. Mertens. December 1977. 



. " . ■ - *". •. TABU OF- CONTENTS , " ^ : ' \^ 

* ■ ■ ' , . Pa^e' 

: qST OF TABLES .*.,.'.-..'..'.'.•.......-.*. • v 

• , LIST OP*APPENDICES , .- . , vii 

INTRODUCTION .....'•.•..*.•..."..»....'.......'■ 1 ' • , 

DIAGNOSTIC AND PR^CRIPflVE REAdInG INSTRUCTION 3 

Introduction 3/ ' 

Overview of Course •. JK 

- Structure o^f CoOrse . ^ . . ^ . . . . ^ • 

■Course Content* and Object)! ves .. . 4 

Method ,..*....-. , 9' 

■Subjects • ^ *. . 9 

. I Procedures and Instrumenta^tion 9 

Achievement Tests 9 

Attitude Questionnaire 15 

Equipment Report and Student Satisfaction Form. 15 

Instructional Activities Rating* Form- . ...... ^ ... \ . . 15 

Summative Report Form 16 

Results* .>%. . . .' •. . . . 17. 

How were participants' learning .and alJtitudes affected? 17" 

H,ow eff-ective were the learning activities and methods of \ . .. 

1 presentation and how might they be improved? 21 

■ . Videotaped Television Programs -21 

\ Seminars ' - . . , 27 

Ancillary Activities •. .'30 

How-reliable was the equipment used during t\\% course? '30 

^ What was'' the overall evaluation of the course? . . .' 38 

• How does this course compare /f?^th the*previous course? 42 

* C^ncl-ustons 1 .... ; r 43 

. . . . ■ ; t 

CAREER EDUCATION IN THE ELEMENTARY SCHOOL . ... ^ ... J .... : 44 

. ' Introduction • • / >: . . . \ . ; . . . • • 44 ^ ^ V, 

^ Overview of Course 44 

♦ ' Structure of Course / 1 . 14 

Course Content and Objectives.^. * . j ; . . . . ' \\ 45 ' 

- Method ^ J ...... ^/^ . / 48 

Subjects . ... \ 4 \ . . . . - 

Procedures and Instrumentat^ion ^ . . . . 49' i 

Cognitive Achieveneift Tests tt^ ..... . ,49 A. 

Attitude Questionnaire . . 51 

Equipment Report and Student Satisfaction Form ....... ^ . 

" ^. • Evaluation Rating^Form 53 

Seminar Evaluation Form ...... ^. ..... ^ 53 

Summary Evaluation Form . * 53 - 

Results . . ^ 54 

How were participants* learning and attitudes affecred? 54 



1 - , • ••■ 

• , • TABLE OP CONTENTS - CONTINUED 

. ■ . . Page. 

How effective were the learning activities and methods of 

presentation and .how might they be improved? 59 

"Videotaped* Tel evi si on Progr^ 59 

Ancillary Activities 59. 

Seminars .... ^ ... ' . . ■» 59 

How reliable was the equipment used during the course? . . v/. . . . 66 

What was the overall evaluation of the course? 66 

How does this course comp'are wi-th- the previous course? ....... 71 

Conclusions V * ^. . . . ^- . . - 72 ■ 

SUMMARY AND CONCLUSIONS ' 73 

, APPEND ICES' . 75 

. ' . . 

I • 



V 



r 



ERIC 



• iv 



8 



■ \ ■ * 

LIST OF WeS 

^ * . i' 

Table ' - ■ - • ' Page ^ 

DIAGNOSTIC AND PRESCRIPTIVE READING- INSTRUCTION. 

1 DISTRIBUTION OF PARTICIPANTS BY OPTIONS AND SITES 10 

2 SUMMARY BACKGROUND INFORMATION FOR PARTI CI i='ANTS COMPLETING 

SPRING, 1977 DPRI COURSE ' 11 . 

3 SCHEDULE OF INSTRUCTIONAL AdTlVITIES^ 14 

4 FREQUENCY OF PARTICIPANTS BY SITE BY CLUSTER INCLUDED IN HANOV^ .'18 ^ 

5 ■ MANOVA FOR PRE- AND POST-ACHIEVEMENT AND AHITUDE MEASURES .... 19 . ^ 

6 UNIVARIATE ANALYSIS' FOR SITES WITHIN CLUSTERS -19 

7 UNIVARIATE ANALYSIS FOR ADMINISTRATIONS (PRE AND POST) 19' 

' 8 UNIVARIATE ANALYSIS FOR THE INTERACTION OF ADMINISTRATION AND * 

SHES WITHIN CLUSTERS . . , .20 ' 

.9 RELIABILrriES, MEANS AND STANDARD DEVIATIONS OF ATTITUDE AND ' / 

COGNITIVE ACHIEVEMENT TESTS /. ' s • • 20 

10 SITE COORDINATORS' MEAN RATINGS OF PARTICIPANT SATISFACTION. 

WITH LEARNING ACTIVITIES. ^ 22 

11 INSTRUCTIONAL ACTIVITIES RATING FORM SUMMARIZED ACROSS ALL 

PROGRAMS, PART I: VIDEOTAPED TV PROGRAMS 23 • . 

12 - INSTRUCTIONAL ACTIVITIES RATING FORM SUMMARIZED ACROSS ALL 

PROGRAMS, PART II: SEMINARS .... ... 1\ ' .' . 23 

13 INSTRUCTIONAL ACTIVITIES RATING FORM SUMMARIZED ACROSS ALL 

PROGRAMS, PART III: ANCILLARY ACTIVITIES 31 

34 QUALITY OF RECEPTION^SUMMED ACROSS *SITES AND SESSIONS . • . • / • . 34 



15 Silt MONITOR'S RATINGS OE^EQUIPMENT FUNCTIONING BY SESSION . - . / 35. 

V-6 SITE MONITOR'S RATINGS OF EQUIPMENT FUNCTIONING BY SITE . . 36 

"17 SITE.MONITOR'S RATINGS OF EQUIPMENT 37 

> ^ ^ ' ,• ■ r 

18 . INSTRUCTIONAL ACTIVITIES -RATING FORM SUMMARIZED ACROSS ALL . ^ . 

PROGRAMS, PART IV: FEEDBACK .39 

1-9 SITE MONITOR'S RATINGS OF LEARNING ACTIVITIES = 41 



O . < ■ ■ ' ^ V 

ERJC ... ■ ■ . ■ , 9 




^ tIST OF TABLES - CONTINUED 

ft * 

Table 'C ■ . . ' , * Page 

.1 ' 

CAREER EDUCATION ik THE ELEMENTARY SCHOOL 

' 20 'DISTRIBUTION OF PARTICIPANTS BY SITES '. ,49 

21 SUMMARY BACKGROUND INFORMATION FOR -PARTICIPANTS COMPLETING 

SUMMER, 1977 CEE COURSE ■ 50 

:Z1 ^ SCHEDULE OF INSTRUCTIONAL ACTIVITfES 52. 

23 AanOYA for pre- AND POST-ACHIEVEMENT AND ATTITUDE MEASURES . . 55 

24 UNIVARIATE AND STEP-DOWN F's FOR PRE- AND P0ST-ACHIEVEME"NT AND 

.. ATTITUDE MEASURES ■ 55 

25 ITEM MEAN^ FROM ATTITUDE SCALE . . ' i . 57 

26 HANOVA 'FOR TEACHER CORPS SITES VS. SATELLITE SITES. 58 

'27 UNIVARIATE AND STEP-DOwii F's FOR TEACHER CORPS SITES VS. 

SATELLITE SITES . " . .• 58 

28 AVERAGE RATINGS OF VIDEOTAPES FOR EACH UNIT \- 60 

2fi^, AVERAGE RATING3 FOR ANCILURY ACTIVITIES FOR eAcH UNIT FOR 

AESP' SITES , 62 

30. AVERAGE RATINGS FOR ANCILURY ACTIVITIES FOR EACH UNIT FOR 

NORTON TEACHER CORPS v ' . 63 

31 SEMINAk EVALUATION FORM SUMMARIZED ACROSS ALL SEMINARS .... 64 ' 

32 ' PARTICIPANTS' RATINGS Ol^ COURSE COMPONENTS AS COMPARED TO 

TRADITIONAL INSTRUCTOR-TAUGHT COURSES ., 67 

33 OVERALL c6uFiSE'RATINGS, BY PARTICIPANTS 69 



- \ . 



. ERIC ; . • ■ ' io 



■" . . , INTRODUCTION 

A survey sponsored by the Appalachian Regional Comnission (ARC) in * 
1971 indicated that teachers in Appal achi a were interested in- receiving 
training in reading instruction and. career education. As a result of these 
findings, the Appalachian Education Satellite Program (AESP) began dlllvertng 
courses via satellite to remote areas of Appalachia in 1974. Four graduate 
level" teacher training courses, two^in diagnostic and prescriptive reading 
and two in career education (one for secondary and one for elementary school 
teachers), were offered to nearly 1200 teachers in eight Appalachian states. 
The results of these courses are documented in AESP Technical Reports #6-9. 
11, 12, and 15. , ., ✓ 

Based on the evaluations made during and following the courses in 
reading and career education, mbdifl cations were made in course delivery 
and content. Following these changes, each coarse was rebroadcast to 
Appalachian educators. This reprort presents .the results of the third 
delivery of the* diagnostic and prescriptive reading course in the Spring'of 
1977 and the second delivery of the career education for elementary teachers 
course in the Sumner of 1977. 

Evaluation of these courses included pre- and posttest measures 
cognitive and affective achievement, participants' ratings of th6 various 
learning activities and methods of presentation, and ratings of the technical 
aspects of the courses. ^. . . 
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In examining tHei^purses, the following questions are addressed: 
1. How were participants' learnings arid attitudes affected? 
2'. How effective were the learning activities and methods; of 
presentation and how might they be improved? 

3. How reliable was the equipment used during the course? 

4. What was the overall jBvaluation of the course? ^ 

5. How do the results compare with the results of ^he previous" 



deliveries of the course? 



Th^ followins sections Qf this report present the answers to these 
questions/ Section two consists of the, results qf the diagnostic and 
prescriptive reading instruction course and section three includes the 
results .of the career education course. Section four presents the 
sumnary and conclusions. ' ' * " ^ ' 
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DIAGNOSTIC AND PRESCRIPTIVE 'READING INSTRUCTION 




\ ' . Introduction ' 

■ Reading instruction is one of the primary needs> in the Appalachian , 
rfegioji. -In order to mefet this need, AESP has offered a cdurse in DiagnostU . 
iand Prescriptive Reading Instruction on three different occasions. The 
results of trie Sumnjer"1974 and ^ring 1975 deliveries are r^ported in AESP 

^'Technical Reports #3, 6, 8, and 12. Jhis re^rt presents the results of the" 
• third delivery of DPRI .in the Spring of 1977. . . 

' Overview of Seurse ' ' ] \\ ^ 

< The Diagnostic and Prescriptive Rea"3rng ^Instruction (DPRI) cdurse is 
intended to be practical and classroom-oriented and' utilizes both teache^^ 
air^ students in brder^ to' illustrate reading techniques. Specifieially, the 
^coarse, is designed to instruct teachers in the diagnosis" of particular reading 
, problem^ and the developftient of individualized prescriptive instr-aptfon to 
« remedy^ these problems.. ' » * 

' Structure of Course ,k^- 

■ • The course fonslstdd of three basic components: ^ ^ 

1) Sixteen 30-jnir|Ute videotaped programs^^ * 

2 J" »Three live, interactive seminars; ^ - 

3> Ancillary activities' associated wjth each lesson. 



". . The earlier deliyeri.es consisted of. 17 videotapes. - The tape entitled, 
Cm^rehenslon ahd Study Skills Tests was eliminated because the fountain Valley" 1? 

Teacher Support Sy^em presented was infrequently implemented by 't^ie teachers. 

I ■ - «• . - - . ^ 



jjjjiring ,the previous two deliveries of the course,' parti dfpants also '. ^ 

utilized four-channel audio reviews a)id an infohnation' retrieval system.^ 

The evaluation results indicated thafthfese components" were not effective . 

• . •• ' ■ ' . 

and- they were therefore eliminated from this delivery. . ^,y/. 

Dr. Lowell Eberwein, Associate. Professor of Educational Curriculum and • . 

• ■ ° ■ A ' - ^ . / ^ 

Instruction at the University' or Kentucky was the instructor for the course. 

Dr. Eberwein, has been instrumental Mn the d?veTopnient of the course §ince its. 

inception. He served as the moderator for the live seminars and reqontnenrfed 

grades for* the students based on th^ip work in^tKe course. 

Participants were able to choose one of thi^ee course options for credit: 

K-3, 4-6, or K-6. Ten of the videotaped programs were viewed 'by all parti ci paints. 

. • -. - ~ ■ 

In addition^ each participant completed three' o'f the'remaining six programs 
.■-.«■'■• * - ., ' • . • ' 

depending on the- course optional ected. Upon completing the course, each ' 

• ' ■ r^ " ' > ' • ■ 

participant received three semester hours of graduate credit.. 

Course Content gtnd Objectives 

*The topics and objectives for the sixteen programs^ were: 
PROGRAMS: DPRI INTRODUCTION— K-3, 4-6, K-6 * 

'1. identify reading sub-skills / / * ' " • 

2. identify th^ parts of the diagnostic-prescriptive 

' » instruction model ' ' • ' * 

3. realize the importance of early diagnosis and 
correction of reading problems 



2 

For explanation of these components, see AESP Technical Report #12, 

- 3 ^ ' ' • 

Since some programs are numbered differently than in the 'earlier 

DPRI courses, requests for information on the programs should specify the 

title. of t)[\e tape being referred to.' • . 



fROGRAM 2: I^iFO 




TESTS - tC-3, 4i.6', K-S 



1. recognize the adv^tage of Informal reading. tests 

.2., Interpret ihe r^U-lts 'Of i^l^^ reading, tests 

* iyentl'W'. the seguence pf Activities involved in 
- . . constiycting'an" informal/ i-eading inventory 

PROGRAM ?r STANDARd/z'ED tj^Ts' --'K-S, 4-6, k-6 ) 

1*. i^tlfy/the procedures necessary for effective- 



in ni strati on of standardized tests 
2.:yihteriiret the results of standardized tests 



3./ recognize the strengths and limitations of standardized." 
tests 

PROGRAM 4: /i/ORO RECOGNITION TESTS — K-3, '4^6, K-J? 

1. administer and interpret the results of the Wisconsin 
. , ' Design for Reading Skill Development; Word Attack 

connect diagnosis to the instructional materials 

3. identify the sequence of activities Invofyed -in "going 
through a complete test-teach-test instructional cycle 
using the The Wisconsin Design for Reading Skill 
Development: • Word Attack T 




PR/iGRAM 5: MISCUE'ANALYSIS - K-3, 4-6, K-6 

1. identify and do the'sequence of activities Involved 
\ - in administering T^e fieadinq Ml scue Inventory . 

)* , *' 

2. categorize reading mi scues ' / 

•3. compile the results of The Reading. Mi scue Invenfev 
on coding sheet 

4. identify WSyne.'s reading strengths and weaknes'ses 

PROGRAM 6: PRESCRIPTIVE INSTRUCTIONAL SYSTEMS — K-3, 4-6, K-6 

' l.. 'translate test results into words (descriptors) that 
' can be used to find mater ia.ls in the retrieval systems 

'2. Identify the sequence of steps in the process of 
•materials selection -> . 
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PROGRAM 7: DPRI MANASMENT-* K-3, 4-6-, - ' ^ • 

* ^ ^ . 1. - identify' several patterns af .grouping . ' J 

2. -assess the strengt^'and limitations oi> grouping] patterns 

. 3. determine the most appropriate, grouping pattern in a 
. given situa^tlon ' . v 

. ■ • ' ; M- - v: 

. .4. recognize -rdasons for using a grouping 4>attern in a . 
• - ' ■■ given situate orf . ' 

■,\"- '''- 

PROGRAM 8: . READING READINESS^ AND BEGINNING READING K-3, IC6 option 
with F^rogr^ 9 ^ " 

• 1. identify activities used to t^ach reading readiness and 
beginning reading ■ - " - . '. 

' . . ., 2. -1 i St, -advantages' knd disadvantages of the activities 

3.] determine which .activity is most appropriate for a 
^ ' given situation ~ " 

PROGRAM 9: THE ^CEPTIONAL READER -V 4-6,, K*6 option with 'Program 8 

' 1. ideftti/y activities and procedures to teach tfie low avQfage 
" • "and gifted'? reader - . . ■> . 

2. list advantages, and di s^vdntages of 'each of the activities' 

, ' ."3. determine which* activity \is most -appropriate for a given 
' ■ -situation ' \ 

PROGRAM ' 10: WORD-mOGN^lKN --' K-3,. 4-6, 

1. identify'activities us^ to ^e^h word recognition 

2, list. advantages" and disadvantages of the activities 

; 3. "defSrmine wh'i<;h activity is mdst appropriate for "a given 
j:. ^ situation " , 

■' ^ " •* - ' 

PRCGRWI 11: VOCABUIJARY— .K-3, K-6 option with Progrim 12 

* ' • 1. identify activities used to teach vocabular}^ 

' , 2. list^^dvantages .and disadvantages of' the activities 

, 3.' determine which activity is most appropriate for a 

: ' , - given situatiofi ... ' • 

- ■ ' _ _ • • , , 
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pLom 12: STODV SKiLLS - 4-6, K-6 option with Prograifi 11 ' * 

1. identify activities used to teach study skills i 

, (list advantages and disadvantages of the activities 

^' ^. determine'. which activity is irio'st appropriate fdr"a 

/ 'J' -given situation- I . * . - - ' 

/' ' " ■ " *,; ' 

PROGRAM COMPREHENSION K-3,, k4 ■opt<on with. Program 14 

ft ^ ' - - » 

1. identify question s^rategi 6s used to teach comprehension 

2. write-'questlbns- to stimulate student responses in 
various categories {i.e. knowledge, translation, etc.) 

' 3. determine the mfi^st appropriate question. strategy for . 

, ' a'jglven- situation . ^ ' , / 

^ROGI^ 14: READING- IN THE* CONTENT FIELDS - 4-6, K-6 option with Program 13 

'1. identify activities used to tea^, reading in the "content fields 

2. list advantages aid" disadvantages of the activities 

3. determtne which activity is most appropriate for a. given 
situation ■ . ' • . / 

PROGRAM 15: DEVELOPING LIFE-LONG^READERS -. K-3, 4-6, K-6 



•1. identify activities that assist in the development of 
. reading interests and tastes 



. '2. list advantages and disadvantages of- the activities' 

3. determine which, activity is most appro"priate for a 
^ ' . given situation" \^ ^ 



PROGRAfl 16: ■ TOTAL READING PROGRAM — K-3, 4-6, 'K-6 * ^ 

. 1. Identify ways to encourage parental partidpatioh in* 
reading programs • . 

'^2, recogrfjze the strengths and limitations of DPRI ' ' 

3. ' cjetermine ways to implement diagnostic-prespriptive 
" reading instruction in a total reading program 

4. determine ways t6 establish, priorities for ifnplementation 
' of DPRI .^^ ' . 



. In addition, all students' participated in thrtfe, live, interactive » 

■ ■ ■ ; / - 

seminars. These seminars provided the parti cip*ants an opportunity to\ 

j ' ' ' ' • 

interact with a panel of expert? in the field of reading' concerning parti cijlar 

/ ' • ' • ' • ■ ' ' V 

- aspects of the :course- content./ ^ ' .• ' > 

Preprogram and follow-up activities associated with each program were 
outlined in the ancillary materials package which was purchased by eath 
student. This material -JTicluded activities desijgn'^d to assist' the student, in 
' applying the techniques- demonstrated in the ^^ideotapes. . * ^ \- • 

In contrast to the previous DPRI courses, no materials were given, 
free. Therefore, each participant was asked to purchase the following 
materials; . ' . / . . 

otto, Wayne and others^. , Wisconsin Design for Reading Skill Development , 

Word Attack; Specimen Set (W-1 ). Minnpafimi<;. M^nnocnta. '^Un'cmnc i „ 
' Design, National Computer Systems Di vision, 1973. Cost $6.00. 

^ Eberwein, Lowell and^ptHers.,, Ancillary Materials ;- Diagnostic and 

, Prescriptive Reading Instruction, K-6. Appalachian Education 

' • satellite Program, Resource CtoPdinating. Center, 1977. Cost $^.50. 

It was ,also necessary that participants have access to the following 

textbooks and they were encouraged to" purchase and use these materials': 

Dall'man, Harrtha and others. The Teaching of Reading. New York: Holt, 
Rinehart a^d Winston, Inc., 1974. Cost 512.95. 

■ ' ' • ' ' 

. Goodman, Yetta and Carolyn Burke. Reading Miscue Inventory Manual. New 
York: Maani'l Ian Publishing Co.,. Inc. , J 97-1. Cost $8.80, 

In addition, one copy of the following mater/I a 1 was needed at each si^e: 

•r ♦ / • 

Otto, Wayne and others. Wisconsin Design for Reading Skill Development , 
Teacher&' Resource'~F1le; Word Attack (W-g) and Supplement Number 
(W-Ss). Minneapolis^ Minnesota: RTsconsin Design, tlatlonal . 
-Computer Systems Division, 197S. Cost $46.00". 
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. Method 

Subjects , • - ' ■ ' • • 

An.average df thirteen parti cipar^jts were enrol/ed at eac1i of 15 Sites 
for the DPRI course* Tfre numter varied because of .more demarW icn some areas 
for reading, instruction and l>ecause some sites were" equipped ^ to accommodate 
more students. In all, 1 97 ' participants took th% pretest aritf 164 completed 
all course requirements* Complete data {all c6grHtive and. affective pre- 
arid posttests) were available for 149 participants* The jiumber of part1<^pants 
site and course option Is presented in Table 1* ' ^ ^ 

A combined attitude and background questionnaire' was administered to 
the course participants prior to the first televised pr(igf!Sm^^Th1s quest ionnaa re 
whlc^is presented jh Appendix , I, was divided into two parts* The first part 
concerned the participants' attitudes toward reading. and the second part y 
sought background Information regarding teaching and educational experiences. 
Table '2 summarizes^ the background^ information obtained* v . - 

Procedures and Instrumentation . / ' , • ^ 

J\' variety of .instruments were used by the evali^ation component to ^ 
evaluate the DPRI course. Copies of all instruments except the cogrtitive ^ 

achievement tests are iijcludeS* in Appendix 1. ' 

. ' ' * ^' ^ - • / -^v - 

• The time schedule for the course, the- learning activitiss for each, ^ 

, - ^ ' ' '* 

class session, and the eva.luation Instruments administered during the course ' 
are ^presented In Table 3. ' ,v ^ . , / \ 

'« Achievement Tests . During the first class session a pretest consisting 
of 40 multlple-choi-ce questigfhs which measured students? cognitive knowledge 
abqut diagnostic and prescriptive reading instruction was administered to * 
all participants* During the eighth, class meeting pai^ici pants completed 



, . • - > TABLE 1 ^ - . 

. , DISTRIBUTION 'OF PARTICIPANTS BY OPTIONS AND SITES ' 

^ ^ . (CorrtpTete Data Cases Orvly) ^ 

site #K V ^ ^ — • Total ' 

X-6 ' . K-3 ^ . 4-6 



10' Huntsvnie, AL, 


. 5 , 


"4 







IV Rains vilje* AL;- 


13 .. 


. 0 


.0 ; 


■ 13 


12 Guntersvllle, AL 


' 6 


'.' 0 


. 0 


• 6 


16 Tazewell, TN , " '* * 


.5 


, 4 


•0 


, 9 


20 Norton, VA j^r 


11 




4 

24 


21 Stkkl^ville,, VA' 




1 


. ■ 0 . 




22 Boone;. NC 


2 


0 


0 ' 


2 


23 . Norton Teapher Corps, VA 
25 Cumberland, HQ 


0 ' 

■ 9 


0 
2 


27" .• 
0 


n 


26 HcHenry, -MO' 


10 


■5 


8 


• -23. . 


* 

27- Keyser, WV 


•1 


1 


0 


. 2 


35 Fredonia, NY 


.6 • ' 


' 0 


1 U 


' 7 


36 Olean, NY . ' . 


.10 


b 


0 


, . lb 


37 Edinboro, PA 


9 




0* ^ 


1 

< 


Total 


78 


. 29 


42- 


149 



^4 
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TABLE 2 ^ 

Nummary background information for par=/icipants 
complehng spring, 1977 opri course - 

(N = 149) ., • ' . - 



Responses 



/requency Percentage 



Sex. 



Age. 



Type of conmunity where 
; participant' worked 



Grade level taught 



Position during ' 
1976-1977 academic 
year 



GRE verbal score 



Male 

Female 

No response 

21 - 30 ' 
31-40 

41 - 50 • . ^ ' 
51 - 60 . . \ 
61 and over ' 
.No response 

Rural ' 
Suburi)an 
-Urban ' 
No response 

Elementary - all grades 
K 

1-3 

4-6, 

7-12 

No response* 

CI ass room. teacher . 
vBeading, specialist 
Special education teacher 
SchooT administrative 

position 
Other 

, No response 

400 or below 

401 - 450 
451 - 500 . 

501 -,550 • 
551 or above * } 

No response 



GRE quantitative .score 400 or be! 



401 
451 
501 
551 



- 450 

- 500 

- 550 
or above 



No response 



30 

117' 



85 
32' 
21 . 
10 

1 

0 

119 
19 
11 
0 

24 
6 

\ 37 
54 ■ 
25 
3 

97 
8 
11 

9 

24 
0 

?• 

7 

7 

2 

3 

1?5 

7 
4 
7 

• 0 
2 

129 



20.0 
78.5 
1.5 

. 57^ 
21.5 
14.0 

6.5 
. 0.5« 

0^-, 

• 80.0 
■ ■ 13.0 
7.0 
0.0 

1640 
4.0. 

25.0^ 
• 36.0 

17.0 
2.0 

65.0 
5.5 

- 7.5 

6.-0 
', 16.0 
. 0-0 

' i1 

4.-5 

2.0 

84,0 

4.5 
2.5 
4.5 
0.0 

. 1.5 
•■ 86.5 
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Responses 



Frequency Percentage 



V 



-Work experience in 
teaching 



; • Experience las a 
' , . reading specialist 



"Undergraduate 'GPA ' 
' ■ (4 points = A) ' 

- 7.;.. 



Graduate- 
. (4 points = A) 



I, 



Last degree (completed 



Taking course for 
credit 



If registered for 
credit, where 



1 year or. less 


. ■ 28 


19. a 


2-5 years 


49 . 


33.0 


5-8 years 


; 28 


19.0 


9-15 years 


- , ' 29' . 


19.-5 


16 years or more * 


I 15 • 


10 0 


No reSDonse 


0 


^ 0 0 


None 


1 28 

1 fas W 


86 0 


1 year or less , 


,10 


, '6.5 


2 -* 3 years 


' 6 


• 4.0 


4 • 5 years 


1 

1 


0.5 


6 years or more 


3 . 


2 0 


No resDonse . 




0.5 


Less tjian 2.5 


lb 


6.5 


'2.51 -2.75 


' 23 


15.5 


Z»7o - 3.25 


40 


27.0 


3.26 - 3.50 


53 


"35.5 


• 3.51 - 4.00 


16 


10.5 


No. response ■' ^ 


7 


•4.. 5- 


■ Less than' 3.0 . 


3 


2.0 


3.01 - 3.25 


12 


8.0 


3.26 - 3.50 


• 9 


6.0 


3.51 - 3.75 . 


25 


17.0 


3.76 - 4.00 


43 


29.0 ■ 


No response 


57 


38.5 


High school diploma 


, 4 


2.5 


Baccalaurkate 


107 


72.0' 


Master's J 


35 


23.5 


Special istv 


1 


0.5 


Doctorate" 


1 


0.5 


No response 


1 


0.5' 


G 

Yes ^ 


' ^142 ' 


95.5 


No 


' 6 , 


4.0 . 


No response 


1 


0.5 


UK ' * 


10 


7.0 


• Other 


. 132 


92.5 


No response , 


'7 


0.5 
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TABLE 2 i- corrriNUfD 



^ - . Item 


.Responses . 

, . - 


Frequency 


" Percentage 


Nunier of undergraduate 


None 


62 . 




reading courses 


T 


41 


• 27.5 




2 ' • 


21 ' 


14.0 


* 


3 ■ , 


■ 12 


8.0X 




4 or more . . • . 


9 . 


6.0 




No response . " 


4 


2.5 


Number of 'graduate • • 


None 


• ' -96. 


64.5 ' 


reading courses 


1 


33 


22.0 


/ 




5 • - 


3.5- 




3 - ^- . 




0.5 




4 or more * 


6 


^ 4.S 


No response 


8 • 


5.S . 

* 


Purpose of present 


Baccalaureate 


2 


1.5 


f*n1 1 ono onv*ft1 Timing 


Piaster s oegree or 








doctorate 


60' 


40.5 




Maintain teaching certi- 








fi'cate 


25 


17.0 - 




Other 


. 27 


18.0 ' 


* 


Not enrolled 


27 


' 18.0 




No response 


.8 


5.5 



a midterm test whidh consisted of 30 it^msifrom the pretest. These items 
were based on information covered i.p..t>ie first ^ix sessions. A posttest, 
which related to 'the last 10 programs, was administered during the final 
class meeting. This test consisted of three versions, one for each of the 
class options: K-3, 4a.6, dnd K-6. Each form consisted of 35 items, 20 in 
COTimon and 15 related to the videotaped program appropriate to the option • 
chosen^ the student. These tests were designed to measure the. cognitive 
learning that took place in diagnostic and prescriptive reading instruction 
as a result of the course. 
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. TABLE 3 
SCHEDULE OF mSTRUCTIOMAb ACTIVITIES 



Session 



2 
3 

4 • 
5 .S 6 
7 
8 
9 

10 

n 

1-2 

• 

13 
14 
15 
16 
•17 
18 



1/25/77 
2/1/77 
2/8/77 
2/15/75 
2/22/77 
3/1/77 
3/8/77 
3/1^77 
3/22/77 
3/29/77 
4/5/77 
4/19/77 
4/26/77 
5/3/77 
5/10/77 
5/17/77 
5/24/77 
5/31/77 



. Activities . 



Evaluation^ 



TV 

^Programs 



Pretest ^ Attitude anil 
Background Question- 
naire 



Mi dtenn ^^uta^ni nati on 



Pdsttest, Attitude Test, 
Sunmative Report Form 



1- 

2 
3 

- 4 
5 & 6 




10 
11 & 12 
13 & 14 

15 

16 " 



Seminars 



Ancillary 
Activiti es 



X 
X 

h 
X 



X 
X 

X 
X 
X 
X 



*In addition to the' evaluation instruments listed on the table: 

•s* ... 

1) the Equipment Report and Student Satisfacti()R Form .was completed after each 
class session except March 15 and May 31 by the site coordinators; 

•« * 

2) the Instructional Activities Rating Form \?as completed by one-half of. the 
participants at each sit:e"after^ery television program and seminar,,. 
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Attitude Questionnaire . Participants completed the attitude portion 
of the Cpmbined Attitude and Background Questionnaire during the first and 
last class sessions. The instrument was qomposed of '21 Likert scale iteijis, 
with 1 indicating strongly disagree and 5 inditating strongly agree. Th& 
instrijraent was 4esigned to measure participants) attitudes toward the methods 
and theories of reading instruction. ' " . ' 



Factor analysis of the attitude questionnaiV-e used during the Spring 
1975 DPRI course revealed a uni factor structure with the .first factor 
accounting for 702 of the estimated common variance (Factor loadings for 
each item are. included in AESP Technical Report #12). The questi;)nnaire 
administered during the Spring 1977 course consisted of the items from the 
earlier questionnaire which had loadings between + .30. Item scores were 
reversed for negatively worded items. 

Equipment Report and Student Satisfaction Form. At the end of each 
class' session the Equipment Report and Student Satisfaction Form was completed 
by the site Qoordinators. This form was used tp report the quality of the 
audio and video signal received and any technical difficulty with the equipi 
ment. The site coordinators also used this form to subjectively evaluate 
the participants' satisfaction with the taped programs, the semiriars, and 

ancillary activities. This form replaced the Site Coordinator's Checklist 

\ 

used during the Spring 1975 DPRI course. [ ^ 

instructional Activitks Rating Form . ' IfpproJcimately one-half of the 
participants at each site completed an Instructional Activities Rating Form 
(lAR) after each class meeting. The even numbered students completed the 
form at one session and odd numbered students at the next session. Thus, the 
responsibility for completinfl'tbe instrument alternated between the participants. 



This questionnaire sought participants' reactions to the session's 
instructional activities and replaced the Class Rating Form (CRF) used during 
the Spring 1975 DBRI^^cojarse. The^estionn'aire covered the television 
programs, the live, interactive seminars', and the ancillary afctivities. The ' 
participants completed only the parts of tjje form that correspondeid to that 
.session's activitiets. The students were 'also asked to rate seven instructional- 

/ • 

activities-. according to the quantity of useful information they received from 
each. The standard of comparison* was the traditional insJ:ructor-.ta.u|ght course. 
A five-point Likert scale (1 = outstanding \o 5 = unacceptable) was used for 
the rating. L " ' 

SummatiVe Report Form . The Sunmative Report Form (SRF) was^used to 
measure *t|}e site coordinator's perception of the overall quality of the course. 
This form re||l'aced the Summative Comments FonjKused during the''Spr1ng 1975 
DPRI course ^Fiich vas completed by both pajrti ci pants and site coordinators. 
For this coyHeT however, student ^atimj/ were includecl on the Instructional 
Activities Rating Fonn, thus elimin^ng the need for the student to complete 
both of thesc! forms. 

*The.SBP asked, site coorMinators to rate each- component of the course 



and their sati 



sfaction with the operation of the equipment. A five-point 



Likert scale (l.* excellent to 5 = \nqacceptable) was used for the ratings. 



„ 'Resujgs • 

As, stated In the introduction,, th.is report is organiied'around four 
research questions. The results for each of these questions follow! 

How were pa rticipants* learning and attitudes affected? 

The resi/tts of the participants^ perfbrmance on the achievement and 
attitude measures were analyzed ufeing a muVtiyariate analysis of variance 
for repeated measures. The factors in the analysis were clusters of. sites, 
sites jiested within clusters, and administrations, ^e four clusters in- 
eluded in the analysis were Alabama, Virginia - North Carolina, Maryland,- - 
West Virginia, and New Ydrk - Pennsylvania (Tennessee was not included 
becafiS^.pre- and posttests were only returned from one Tennessee site). 
The frequency pf participants at eacfr s.lte by cluster included in the 
analysis*" are presented. in Table 4-, Only those participants who completed 
•the pre- and post-alj^itude measures, and the pre-, mid-, and'ppst-achieVe- 
ment measures werl included in the analysis (total. = 140). ^ 

, The results ^ the multivariate analysi.s of variance are presented 

•f 

in TaWe 5. The results indicate 'a signfficant difference pverall for 
sites within clusters, for administrations, and for the interaction of 
admi^nistratiohs and sites within clusters. The results of univariate 
analysis of variance for the dependent measures provide added insight intp 
the irteaning of the above results. These ar^eported in Taljles 6, 7, and 8. 

The results indicate that the changes occurred only on the achieve- 
ment measure. The participants did riot manifest a' change in their .attitudes 
as a re^lt of participating in the course. The results Indicate that 
differential improvement "occurred for the participants on the achj,eVemmit 
measure within sites in clusters. Nevertheless, 1^ was an overaTl 
significant improvement on the achieyeiiient measure from pre- to pqsttest. • 
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- ' '' ' . TABLE 4 • ^ . , ^ ' 

^ FREQUENCY 'OF PARTICIPANTS BY SITE BY CLUSTER INCLUDED^ IN MANOVA 

_ Site |)y Cluster , Frequency 



"Alabma i ^ ^ 

Huntsville . ' • V ■ ■ - '9 

Rainsville . 13 

• Guntersville , ^ - • 6- . 

Virginia - North Carolina / / . - # 

Norton ' , .24'. 

fckleyville • ^ ' ' 5 

Boone . . , . < 2 

Norton Teacher Corps , ' , 27 

' . " - ' * ' ' • 
Maryland - West Virginia . 

Cumberland ■ . ' : - • 11 

McHenry 23 

Keyser • - ' . ^ 

New York - Pennsylvania ' ' 

Fredonia ' 7 

Olean* ' " , ' 10 

Edinboro • 1 

' " > - 

. Total 140- 



« - ■' TABLE 5 . ' • 

MANOVA FOR PR^ AND POST-ACHIEVEMENT AND ATTITUDE MEASURES 



- / Source 
/ 


d.f. 




Multivariate F 


■ 1 


'Between Subjects 




J 






Clusters (C) 


8.16 




1-32 


.30 


SHes with'in .Clusters <S:C) 
Within Subjects 


18.268 




1 

2.20 


.0039 


Adinlnl strati ons (A) 


. ^,134 




• 

■ 312.45 


# 

,.0001 


A.x C 


' 8,16 




1.27 


.3234 


» A x*S:C 


18.268 




2.56 / 


.0007 




TABLE 6 








UNIVARIATE ANALYSIS FOR SITES WITHIN CLUSTERS* . 














/ > ■ ■ . . 
Source * Mean Square Univariate F 


p< 


Step-Down F 


* 

p< 


;Att1tude . ' . 1.58 ., 


1.81' 


.07 


1 .81 


• 

•- .07 


Achievttnent 595*26 


2:37 


.02 


2.61 

\ 


.oob'* 



.... --^ ' 

^ ' : ■ ' TABLE 7 '• 

UNIVARIATE ANALYSIS FOR ADMINISTRATIONS (PRE AND POST) 

Source . Mean,^quare ' Univariate F . p< Step-Down F p< ' 

- - * - « ' ' . . ^ 

Attitude. • ' ".44 / .72 ^ - .40 ' . .72, .4o| 

AcHievement- ' 73220>00 '•629.41" .0001 , 1520. 89v ^ .0001 



'v * • . • . " \ TABLE 8 • > • . 

UNIVARrAtE'ANALYSIS FOR THE INTERACTION QF ADMINISTRATIONS 
AND SITES WITHIW CLUSTERS 







1 








Source 


.ffean Square 


Univariate F 


p< 


Step-Down F 




Attitude 
♦ 


1.T5 ' 


:1.89 


;06 


1.89 


.t)6 


Achievement 


; 381 .AS' 


. 3.28 

* 


.002 


3.27 

• 


.002 



TABLE- 9 



RQUABILITIES, MEAflS» AND STANDARD DEVIATIONS OF AHITUDE 
• ^ . ' ^AND COGNITIVE ACHtEVEMENT TESTS 



■ ■ '' ' • / 
. . ' Number of itsns < 


' Mean 
(Items) 


Mean 


• SD 


N 


Attitude pretest 


21 ^ 




74.75 


13.26 


149 


Attitude posttest 






, 76.14 


12.68 


149 


Cognitive pretest » 


40^': 


.72 


38.2 


7.66 


149 


Cognitive midterm 


30 - 


.74 


21.9 


4.01 


149 


Cognitive ppsttest 












K-S option, 


35 


.65 


22.4 


3.95 


29^ 


4-^ dptibnV ' 


35 


.72 


'/ 24.6 . 


. 4.-21 


■ 42 


K-6\option 


35^ . • 


.69 


2^15 . 


4.75'\ 


78 

• 



This test^actually had 50 items. However, there are three option points and 
each 'per^n only answered 35 items. - ; - 

Table 9 presents the means and standard deviations for the several 
versions of the achievement tests used to measure cognitive achievement 
and for the attitude pre- and posttest. * , . 
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How effective were the Teaming activities and methods of presentation and 
how mlpht they be improved? . • 

•The Instructional Activities Rating Form (lAR) and portions of the 
Equipment' Report and Student Satisfac^n form were 'use'd-to eyalua-{;e the 

perceived effectiveness of each learning activity. The-following learning 

** ' r ' « " . ■ ■ 

activities' were rated: 'videotaped TV programs, seminars, 'and ancillary 

activities. Ratings for each activity on eath day" were obtained from fhe 

lAR. These ratings for each item were suimarized tor al'l class meetings ' 

^ • ' ' • • ' 7 - y ^ ^ 

and^are discussed in the follovfing parts of this report. ySite coordinator's 

ratings of student satisfaction of the learning activities are presented in 

Table 10. - • 

Videotaped Teltevi ai on Programs ♦ Table 11 presents the students' 
evaluation, of the televised programs. Overall Evaluation of the videotaped * 
lessons vfes between "good" and "very good". On a scale of 1 to 5 where I 
is excellent and 5 is poor, the^ average overall rating for tlie program was 2.68, 

The o.ther items were rated similarly. The majority of tHe participants 
felt that coverage of material and the amount of time spent discussing 
theoretical aspect's, procedures, and examples were adequate (items 6,/?, and • 
8). In all cases, ^wever» a "significant number felt that more time should 
have been^spent on 9ll these areas, and that the programs would have been more 
effective 'if less material had' been presented but in greater depth. T|ie most 
frequent suggestions for jmprov^ent were amplificatfon of main points, and 
more summary statements. \ ' * ^ \ . , ' 

Comments focused mainly ^on the pace and1?fie technical quality of the 
prograins: y< 

S« - supplied* a lot of information too fast to.comp'riAend v^tell 
- too much covered and not in depth enough 
, ' ^.more cavera§e at slpwer.pace 
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SITE COORDIUJATORS ' * MEAN. RATINGS' PARTICIPANT SATISFACTION 
. • WITH. LEARNING ACTIVITIES ' • 













Session 


Program 


- • ■ V ■«/ 

Videotaped » 
Progf'am * 


Seminar 

„ . :. - 


And Mary 
Activities - 


> 


TV.r . 


• 2.43. 




2.50 


2 


TV 2 


2.42 




2.38 


. 3 


TV* 3 






2.38 . • 


'4 


TV 4 


^ \f J.90 


• 


' 2.22 


5,& 5 


TV 5 & 6 


1.92 


1 




7 , 


Seminar V 




2.00 


• 




/ \ 

Exam 








9 


TV ? 


1.89* \ 






10 


TV 8& 9 


t.67. 




'2.0b*- 


M 


Seminar 2 




• 1.38 


ft 


12 . 


* 

TV. 10 


1.90 ^ , . 


• 


1.63^^ 


13 

• 


TV 11&12- 

* 


1.80 " 




2.22 


1 14 


^Tv is&u 


1.6'4- 


i 


A 1-89 


'l5 
16 ^ 


TV 15 
Seminar 3 


U90 : 


1.89 


- ""\ . 


■ . 1? 


TV 16 ^ 






, 1.75. ) 


'18 


Exam 








Toial 


« 


1;97 

* 


^ - ' 1.71 


2.08 



Ratirfgs: 1 » excellent 
• . ' 2 » very good 

3 =* good 

4 « fair 

5 » poor' 

•\ * ' . ,. 
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i' # 
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INSTRUCnONAL ACTIVITIES RATING FORM SUMMARIZED ACROSS ALL PROGRAMS ' 
■ pAkT'I: VIDEOTAPED TV PROGRAMS ^ 



Item # ' 



Content. 



f^requency Percentage 



V 



ERIC 



-V 7- 

iscu^sion of 



mater iaVs was: 

\ * 

\ 



1. The presenter's di 

a) e){cenent 
^ b) very good 
cl good 

' ^ ' d) fair ' . . - 

' e) ;'poor 

Z. Tt>e classroofn scene with 'the presenter 
describing activities Was: * ^ 

a) excellent' 

b) very good - ^ ^ ^ 

c) good . • 

d) fair ; " ' • - ^ 

e) poor 

The presenter's expUnation of the 
graphic materials was: > 

"^.a) excellent 

b) 'very- good 

c) - good ' : ' 

d) fair 

poor • , \ . 

The* scores of a teacher working with'students 
Were: 

• a) excellent • 

, bj ' very good 
c) good „ . ^ 

■d]L fair . , ' 

ejT • poor ^ 

5. The interviews of experts or. practitioners 
were: 



a) excellent 

b) very good 

c) good^, 
d/ ^faip ^ 
e) ' poor 




c 



V 



33 



160- 


U% 


447 


39% 


440 


38% 


102 


. 9% 


9 


n 


123 - 


11^ 


436 


38% 


477 , 


m ■ 


100 . 


9% 


13 


n 


70 


6% 


351 


31% 


538 


■ m 


134*. • 


■ 12% 


"26 


2% 



133 
419 
467 
116 
15 



99 
379 
485 

in- 

• 15 



n% 

36% 
4n 
10% 
IX 



9% 
35% 

m 
m 
> n 



0 



Item # 



. 2r 

TABLE 11 — CONTINUED 



Content 



Frequency . Percentage 



6. 



7. 



Amount of time discussing theoretical 
aspects: 

a) much more time-, 

b) somewhat more time ** 
cj coverage was adequate , . 

d) somewhat less time . ' \ . 

e) mucn. less .time ^ " 

Amgunt of time discussing procedures for 
using materials: > / 

a) much more time / • : • 

b) somewhat more tfme 

cj coverage was'acjjequate 
dj sdmewhat less t^jne 
e) much less time^ 

Amount of time spent on examples^ of 
•application in 9'iassroom: 

/ 1 
a) /much more 4ime 
b") somewhat /more time 

c) coverage' wais adequate 
dj somewhat less time 

e) much less time 



9. Program more^effective if: 



8. 



10. 



66- 
, 223 
778 

■tl5 
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a) less material at greater depth ^ ■ 

bj. les^ material 

cj more material in less depth 

d) more' material relevant»to central issues 

e) coverage was adequate 

The presenter might have be6n more acceptable 

. . : 'I 

a) he/she ^po'lce more clearly 

b) he/she ajDpeared more knowledgable 
about subject area 

c) he/she spoke in a more natuVal manner 

d) he/she was quite acceptable 

n. The program might have been easier to 
fdllow with: , 

a)'' more explicit tr'ansitions between ideas 
;/ b) more careful organization of content 
c) greater amplication. of mai^n points ^ 
' d) more summary statements - ' > . ■ 

-< r . -< 34 




147^ 
78 
476 • 
1/^95 



62 
19i 
68% 

6% 

n 



89 


* 8X 


306 • 


26% 


708 


62% 


47 


• 4% 


6 


1% 


86 • 


7% 


293 


25% 


706 


■ 61% 


55 


^ 5% 


11 


1« 


208 


■ 18% 


•74 


6% 


89 • . 


8% 


118 


10% 


658 


57% 


66 


6% 


33 


. 3% 


164 


15% 


835 


76% 



15% 
8% 
48% 
30% 
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' TABLE n ~ CONTINUED 

> 



Item # 



Content 



• Frequency Percentage 



17. 



12. , Effect of^program on teaching: , 

a) little or no relevance 
bi would likefto use it, but probably won't 
c) would like to use it, but don't under- 
' stand it enoujh , , • ' 
I'' dY *! plan to use it . ' 

e) something f already know, or am using 



13. Graphic materials could have been used in 
the program: \ 

a) much more frequently 

b) mora frequently \ 

c) use was satisfactory^ 
' dj less frequently 

e) much less frequently 

1'4. Graphic materials needed to be held on 
the screen:*' y 

a) much longer 

b) somewhat longer\ 

c) time was adequate 

d) somewhat shorter 

e) much shorter ^ ^ - 

15. The pace of the program should be: 

a) much slower, ^ 

b) somewhat slower 

cj pace was satisfactory 
^ d)/ somewhat* faster 
^ ' e) ipuch/raster 

16. TheX^^J^ity of the picture was:. . . 



?ERLC ^ 



a) excellent 

b) *vyy good 

c) good 
'dj fair 
. e) pooi^ 

Tfte^^jueTfity of the ^ound was: 

"10" excellent , ^ " 

b) very good 

c) ^od ' 
^d) fair , 
'"eV poor 



9 



115 
173 

140 
590 
125 



55 
215 
827 

37 
5 



35 



185 > 

351 

589 

8 

2 



122 
316 
6^ 
58 
4 



211 
3M 
366 
154 

87- 



170 
332 
355 
182 
121 



10% 
15%" 

12% 
52% 
11% 



5% 

19% 
73% 

3% 

0 



16% 
31% 
52% 

1% 

0 



n% 

27% 
57% 

5% 

0 



18% 
30% 
31% 
13%. 
7% 



. 15%. 
29% 
31% 
16'% 
10% 



2'6 



TABLE U ~ CONTINUED 



Item # 



Content 



Frequency . Percentage 



18. There were annoying distractions jln the 
room: - ' * • ' 

a) Trvery often ^ 
bj often 

c) occatloc^Tly [ 




d) rarely . 

e) never 



Overall evaluation of TV pyRogram: 

« * ' 

a) excellent 

bj very good • * 

cj- good ' ' 
d) fair . ^ • 
, e) poor . ; 



20. Do you have a specific conmeSt: 

^a) yes 
b) no 



37 
70 
266' 
479 
303 



86 
407 
475 
164 

21 



80 
1028 



3% 
6% 
23% 
41% 
26% 



35^"^ 
41% 
14% 
2% 



7% 
93% 



.- program too fast ' - * • 

- garbled sound t 

- audio-video problems " ' * • ' 

- sound low - 

- couldn't hear 

, ' ' ' 

The majoHty of the participants (76%) felt that the presenter was 
quite acceptable. Sixty-three percent of the participants Indicated that 
they plan to iKe'DPRI In their tea'&hlng-or were xilr6ady doing so. These 
results are^ similar to those obtained. during the earlier DPRI course. 
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Si te^moni tors' comments varied from extremely positive to critical 
and 'focused, primarily on the program content: * * 

— • not^ enough specific information 

- use advanced organizers 
• - lectures were good and content very worthwhile 

- .quality of content excellent / 

- some material outdated. 
Seminars . Participants' ratings of the live, interactive seminars are 

presented in Table 12. The overall rating of the three seminars was 2.55 which 
is between "good" and "very good". Each seminar was rated similarly although 
the second was rated slightly higher than the first and last. The majority 
of the participants felt that the answers they received were useful and 
valuable and that questions should continue to be answered via teletype and 
VHF. The most fr^ent .suggestions for improvement were the use of more direct 
answers, occasiona1*^|Mmmary statenents, and more classroom examples. 

Most of the comments, however, were positive as indicated by the 
representative comments below: 

- well organized 

- guest speakers were well informed > 

- seminars more valuable than TV sessions becaus.e they're more specific 

- monitor summarized and added to guests' responses 

- jnformal atmosphere is very good. , ^ 
The site monitors rated student reactions to the seminars. The average 

rating 'for all three seminars was 1.79 (on a 1 to 5 scale). The, site monitors 
also rated the second seninar higher than the other two, giving it a mean 
rating of 1.38. 
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TABLE 12 



^ INSTRUCTIONAL ACTIVITIES RATING FORM SUMMARIZED ACROSS ALL PROGRAMS 



PART II: SEMINARS 



Itero # ^ Content Frequency Percentage 

■ - ^ 

21. - improve effectiveness of seminar by.format 

change: 

* 

a) -1- hour TV seminar and 15 minutes 

intermission * ^ 88 282 

b) 2 hours TV seminar and 15 nrfnutes 

intermission 23 1% 

c) 1 hour TV seminar, and opportunity to 
. generate questions during and 15 

minutes prior to the program loi 32% 

d) 1 hour seminar with direct voice hook-up 98 32% • 

e) other -10 

22. Iirorove effectiveness of seminar: 

a) moderator answer questions alone 27 s% * 

b) use more teachers as guests 60 20% 

c) use more professors atid experts as guest -n, 54 18% 

d) fine as is • 162 53%. 

23. Facilitate the generation of more meaning- 
ful questions: 

a) begin with 10 minute course content^ 
summary 106 . 35% 

b) begin with 10 minute film of previous 
programs ' ■■ . 41 14% 

c) begin with ^hort film of new material 55 18% 

d) use whole seminar for question answering 
and. discussion 97 32% 

ey other . • • . 2 1% 

24. Increase the value of the answers. to the * 
questions: 

lessjthetJrTT ' 1 17^ 6% 

more classroom examples . ' . 61 • 20% 

more direct answers " 80 27% 

l-ess repetition in answers 20 7% 

satisfied as is " 123 41% 
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TABLE 12 CONTINUED 







.27 


m 


160- 


62% 


23- 


9% 


49 


m 



• Itein # Content ' ; Frequency Percentage 

25. Seminar moderator more effective: 

. a) keep guests more on topic 

• b) provide occasional summary statements 
cj- allow each guest equal time 

d) keep a faster pace 

26. The ^f11m■ segments used as sources of 
stimulation were: * . 

a) ^extremely useful 13 -5% 

b) very useful » . 48 18% 

c) somewhat useful , ' 86 32% 
dj completely useless ' ^ 5 2% 

e) not applicable . 115 43% 

27. . Advisability of continuing to answer 

questions via teletype or VHF: 

* -. ■ < 

a) yes v 244 86% ' 

b) no ^ 41 ' 14% 

28. Usefulness of answers received via 
teletype or VHF: 

V a) yes • . 227 83% 

■ " \b) sUb ^ ' -45 ..*»17% 

29. Overall ,ev£^luat1on of seminar: , 

' a) excellent 39 * 13% 

b). very good * 111 37% 

cj good 101 34% 

d) fair ' . 40 13%' 
e; poor ' ' 7 2%, 

30. Specific conments: • • V . 

- a) yes 27 9%. 

b) no 258 91% 
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Anci nary Activities. Table 13 presents participants' ratlngs^y^the * 
ancillary actlyltles used during the course. The overall evaluation of the^ 
ancillary actlvltfes was between "good" and "very good"^ (average rating = 2.75), 
Fifty-eight {Percent of the- participants agreed -that the assigned .work was 
useful and 732 felt the activities could be appUed to. their classrooms. 
Fifty percent of the participants felt that too much reading material was 
assigned.. Only OT of- the stu'dents spent more thair one hour working on 
laboratory activities. .Representative comments varied: . 

- too much reading \ ' • ' 

- simplify directions ran activities 

- quite ... well prepared 

- assignments are interesting and helpful. . ' 

Site, monitors rated students' satisfaction with the ancillary materials 

,' • 

as very good (average rating =2.02). 

» • 

f . * 

/ 

How reliable was the equipment used during th e'' course? 

The videotaped programs and interactive, live seminars were broad- 
cast via the ATS-6 delivery system. The questions during the .seminar - * 
were -tr^raitted from the sftes by teletype or telephone. 

Forllowing each program, the^4te monitors completed the'Equipment 
Report and Student Satisfaction FontrjERSS). This information was used 
to determine'the reliability of the equipment and the quality of the 
reception. Table 14 summarizes the ratings of the audio and video reception. * 
across all sessions. The video signal contained little or no dfstort.ion 
86? of the ttme and the distortion was only slightly or not at all, annoying 
892 of the time. The audio signal^was rated *as good 87% of the time and 
the signal strength was good 8U of the time. 



■ TABLE 13 . 

IimfUCTIONAL ACTIVITIES mm FORM' SUMMARIZED ACROSS ALL PROGRAMS 
PART III: ANCILLARY ACTIVITIES 



Item! • 



Content 



Frequency t .~ J^ercentage 



31*, Use of materials from reference shelf; 



a) very often 

..b) Often 

c) occasionally 

dj rarely 

e) never 



32. Amount of* time spent working in lab: \ 

a) aoiminutes or less 

b) 45 minutes 



c) 60 minutes 
d) 



33, 



90 minutes 
e) two hours or mo^ 

Ancillary activities should have covered: 

a) much more material 
h) ^ somewhat more material 

c) 'material covered was adequate 

d) somewhat less materlaf 

e) much less material 

34. ' Instructions for ancillary , activities were 
i clear: • ' . : 

a) strongly agree * * - 

b) moderately agree 

cj no opinion or neutr^tl 
, . ..d) moderately disagree 

e) strongly disagree - ' « 



79 
184 
305 
156 
256 



17 
46 
688 
220 
78 



195 
480 
203 
142 
37 



35; Ancillary activities were relevant to 
the TV fJTogram: 



. aj strongly Agree, 

bj moderately agree 

c) no 6pi,nion or neutral- 

dJ moderately disagree 

e) strongly disagree 



275 
550 
157 
63 
10 



B% 

m 

31% • 

16^ ■ 
26% 







314 


30% 






229 


m - 






212 


-20% 


/ . 




197 


'19% ^ 






• 95 


' 9% 



2% 
4% 
•66% 
21% 
7% 



18% 
45% 
19% 
13% 
4% 



26% • 
'52% 
15% 
. 6% 
• 1% 



TABLE 13 — CONTINUED 



Item # 



Content 



Frequency percentage 



36. Time .allowed for completion of'ancillalry 
activities adequate: 



38. 



40. 



strongly agree 
moderately agree 
no opinion or neutral 
moderately disagree 
strongly disagree' 



37. Ancillary activities practical and 

applicable to the classroom: 

» 

. a) . strongly agree 

b) moderately agree 

c) no opinion or neutral 

d) moderately disagree 

e) strongly^disagree 



Too much teading material assigned for 
class preparation: ^ > 



P. 
a) 

b) 



.strongly agree 
moderately agree, 
no opinion or neutral 
.moderately disagree 
strongly disagree 



39. Preparatory r^Efdings njore relevant^to 
^illary activities: 

strongly agree 
moderately agree 
no opinion or neutral 
moderately disagree 
strongly disagree . 



Materials on reference shelf not relevant 
to ancillary activities: 

strongly agree* 
.moderately agree 
no opinion or neutral 
moderately disagree " 
, strongly disagree 



• 146 ' 


. 14% 


446 


.42% 


197 


19% 


177 


17% 


90 


9% 


'217 • 


21% 


'544 


52% 


188 


18% 


78 


7% 


26 


Z% 


212 


zo% 


314 


30% 


321 


30% 


1'57 


15% 


53 


. 5% 


47 


4% 


243 


23% 


478 


46% 


'205 


20% 


75 


7% 






■ .43 


5%. 


133 


1-4% 


470 


49% 


198 


21% 


115- ; 


12% 



r 
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Ite;n # 



.Content 



TABLE- 13 — CONTINUED 



Frequency Percentage 



41 ♦ Assigned homework quite useful: 






a) strongly agree ^ 

c) no opinion or neutra^l " ' 

d) moderately disagree 

e) strongly^disagree 


156 

453 
297 
114 
32 


^5% 

43% 

28% " 

m ■ 

3% 


42. Overall all evaluation: 






a) excellent. 

b) -very good ■ fi . ' 
' c) good' •• 

• d) fair 
e) poor " * 


66 
354 
462 
167 

19 


44! 

\e% 

2% 


activities: 






a) 'yes 

b) no - . 


166 
810 


m 

B3% - 


44) Specific comnents: 


r 




a) yes ' 
b-) no , 


c-55 
958 


5% 
95% 



Site monitors' ratings of equipment functioning of the ATS-3 system 
across all sessions are presented in Table 1^ and ratings by sites are 
presented in Table 16. These results indicate a great deal of variability - 
from site to site and session to session in technicjil quality of the programs 
• Site monitors aUo used the .Sumnative* Comments Form to rate several 



aspects of using the equipment connected with^ the course 



These, results are 
responding fett the 



presented in. Table 17. Only one out of 12 site monitors 
eqWpment and rela^d procedures were difficult to use and did not' like 
operating the equipment. Less than half of the monitors j-esponded to items 
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. TABLE 14 . ' 
QUALITY OF RECEPTION SUMMED ACROS? SITES AND SESSIONS * 



4- 



Frequency - Percentage 



Vi d eo-Slfinal Rating 



Perceptibility. ■ ^ ' % 

1., Picture. not perceptible. • 

2. Very perceptible distortion 

3. Some distortion 

4. Very little distortion 

5. -No distortion 

ObjectionabTeness 6f distortion. 



1. ■ ExtreJnely ajnnoying_. 
v,2. Very annoying' . 
3. Definitely annoying 
'4. Slightly annoying. * 
5/ Not annoying" , 



-3 



Readability 

1. Poor 

2. Fair 

3. Good- . ' 

Signal Strength 

J. Very weak' 
r2. Fair 
■3. Good '// 



Audio Signal Rating 



11 


6% 


7 


4% 


7 


^% 


28 


m 


128. , 




12 


n 


■4. 


2% 


"4 


2%- 


36 


* 20% 


'125 


■ 69% 






10 


• 6% 




- 8% 


157 


87% 


. 13 


7%' 


22 


12%- 


146 


81% 


service. 


This 



liinited response iilakes conclu^ns ^bout the repair service difficult. The . 
jnost fi^equent complaint, however, was with the quaHty of the reception. 



■ . TABLE 15 ■ ' 

-SITE MONITOR'S RATINGS OF EQUIPMENT FUNCTIONING BY SESSION 



Session . 


Date 




. ' Video 




?/1/77 


3.00'''x 2.92 


4.46 X 4.46 


2 

• • 


• 

2/8/77 


2.85'x 2.62 . 


4.00 X 3.92 , 


3 


2/15/77 


.3.00 X 2.92 


4.75.x 4.75 




.2/22/77 


2.58 X 2.50 


;3.83 X 3.92 , 


. 5 _ • 


3/1/77 


^77 X 2.77 


: 4.54 X 4.62 ' 




3/8/77 


2.85 X 2.85 


4.38 X 4.46 


7 


• 3/«2/77 


. ■ 2.75 ^ 2.83 


4.83 X 4.75 


8 r 


3/29/77 


' ^ 2.83 X 2.75 


4.50 X 4.50 


9 


« 4/5/77 

• 


3.00 X 3.00 
2.67 X2.50 ^ 


4.82 X 4.82 

1 


c ♦ 

in 


4/1Q/77 


4 17 X 4 00\ 


n 


. 4/26/77- 


. „ 2.75 X 2.50 


-4.42-x 4.42- 


• 12 


5/3/77 


?.00 X 3.00 


'4.83 x 4.83 


13 


5/10/77 


2.83 X 2.75 


; 4.83 X 4.'83 


14. 


' 5/17/77 


2.64 X 2.55 


' 4.27 X 4.27 




5/24/77 


^ 2.64 X 2.55 


' 3.^2.^ 3.82 



Video Signal Rating Scale .. ^ 

Distortion and/or Noise Perceptibility Pi stO|rt1 on and/or Noise 

OMectlonableness 

1. Picture content impossible to ascertain . , * • 

*2. Very perceptible distortion and/or 1. Extremely annoying 

ftoise but picture content ascertainable 2. Very annoying ^ 

.3. Definitely perceptible distortion and/ "6. Definitely annoying 

or noise , - 4. Slightly annoying ^, 

4; Barely pergeptible distortion and/or . ' 5. Not annoying 

'noise ' \ . . . , . . 

S^,:.Iinper<5eptib1e • Audio Signal Rating Scale 

Readability > , Signal Strength ' ' . 

1. Unreadable '1. Faint signals or very weak 

o^i Readable With difficulty ' signals 

ERJC i. • Readab'le wtth practically no 45 2. J^air signals 

d1ff1<:ul1;y, or no difficulty 3. • Good signals or very good signal 



. TABLE 16 ■ 

SITE MONITOR'S RftTINSS Of EQ^^PMENt FUNCTIONING BY SIT^ 



Site 



Audio 



Video 



•10 Huntsville 


2.80 X 2180 


3.93 X 3.87 


11-. Raijjsville 


• 

2.27 X 2.20 


3.87 X 3.80 


J 2 Suntersvine . 


2.73 X 2.20 


3.24 x-3.40 


ID Larol 1 ette 


3.00 X 3.00 


' 5.00 x^j5J]0 


10 IdZGWei 1 _ . 


2,85 X. 2.85> - 


4.77 X 4.77 


nurwon ^ [ 


o.OO X 3.00 


4.86 X 4.79 




^•oU X C«t)0 


4,73 X 4.73 


22 Boone 


3.06 X 3.00 ^ • 


5.00 X 4.87 


25- Cuniberland 


3.0O X 3.00 ''^ 


4.80 X 4.80 


26 McHenry 


.2,57 X 2.57 


4.00 X 4.00 


27. Keyser 


3.00^ 3.00 \ 

t 


4.00 X 4.O0 


35 Fredonia ""s^ 


2.93 x 2.93- 

• « 


• 

4.73x4.93 


36 Olean 


' . 2.71 X 2.71 


4.50 X 4. 50. 



, Video Signal Rating Scale 

Distortion and/or Noise Perceptibility 



1. Picture content impossible to ascertain 

2. Very perceptible distortion and/or ' 
noise but .picture content ascertainable 

3. DeflnHely perceptible distortion and/ 
or no^se 

4. Barely perceptible distortion and/or 
noise > - 

5. Imperceptible ' . Audio Signal Rating 



Distortion and/or Noi3e 
Objectlonableness ^ 

1. Extremely annoying 

2. Very annoying 

3. . Definitely annoying 

4. Slightly annoying 

5. Not annoying 

Scale 



Readability 

1. Unreadable . . 
1, Readable with difficulty 
3. Readable with practically no 
diffidulty, or no difficulty 



Signal Strength • 

1.. Faint signals or very weak 
. signals ^ 

2. Fair signals 

3. Good signals^r-v6ry^,g66d signal 
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'SITE HONHOR'S RATINGS OF EQUIPMENT 



: , 

Frequency . PetxenJbage 



■t; — The tHjuipiuenl Is ttdsy>to use:. : 

■ a) strongly agree 
b) agree 



c) neutral 
d) 



disagree 
e) strongly disagree 



2. I like operating -the equipment: 

a), strongly agree S 
fa) agr^ . ' - ^ 
c) neutral 

3. Equipment check is easy to do: 



disagree 

strongly disagree 



a) Strongly agree 

fa) agree 

c) neut:ral 

d) disagree 

e) 5trongly disagree 



4, Equipment Report and Student Satisfaction 
instrument is easy to use: 



a] 

fa 

cj 

d 

ej 



stnongly agree 
agree. ■ 
neutral 
disagree 

strongly disagree 



Repair Service 
was satisfactory • stron 

UHF i ' 

Teletype 
Telecopier 



agree 



2 
2 
1 

1 . 



agree 

4 1 

1 

2 

. JD 



neiitral 
. 2 

0 

0' 
0 




7 
2 
1 
1 
0 



c 

1 



disagree 
0 

0 

i 

0 , 
0 



•m 

18% 

9% 
0 



55^ 
27% 

-n 

0 



strongly disagree 
0 
3 

• 1 

0. 
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What was the overall evaluation of the course? .. , a- 

Tbe overall rating of the course was obtafrted from participants' 
responses'bn Part .IV of the Instructional Activities Rating Form. 5even 
aspects^ of the course were rated in cdmpartsoh to traditional instructor 

taught courses^ The frequency a nd moans for each itgm ar e pr e sented iy 

Table 18. The site monitors received the highest ratings with an average 
of 2.11 which is" good. This re^lt Is similar to the earlier course when, 
the^e copfdinatprs also received the highest ratings. The. other 
features .of the course were all rated similarly and were between good and 
aiverage. On- site .references were rated the lowest with, an average rating 
of Z.6Z. Jhis may have been a reflection of stiident dissatisfaction. that , 
all site^ did not have sufficient on-site resources available where^hey' 
were meeting. 

The otrerall rating of the course was also measured by the Summatlve 
Coiments Form wh$ch was complete % >s1te monitors at the completion of the 
course. The monitors rated the television lectures, the live seminars and 
the ancillary activities on several criteria. Table 19 presents the results 
of these ratings. v 

The televised lectures received the highest overall rating and the 
highes-t rating on quality of presentation although, the seminars and ancillary 
activities were also rated above average. The/mcillary activities were 
rated the highest of the three aipettsof the course in relation to other 
unit activities. The content of the programs was rated highly for all the 
activities. Student reaction, although above* average, was rated somewhat 
lower than other aspects, — 
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TABLE 18 



INSTRUCTIONAL ACTIVITIES RATING FORM SUhWARIZED ACROSS ALL PROGRAMS 

PART IV: FEEDBACK ^ 



Item # 



Content 



Frequency Percentage 



Quantity of useful Information received 
.compared with a traditional instructor • 
taught cnurse-. . .. 



45. Pre-program preparation:- 

. a) outs^tanding 

b) > good 

c) average 

d) poor 

--_^.) unacceptable 

Mean = 2.51 

« 

46. Televised, interactive senrinars: 

a) outs^tandiig 

b) good 

cj • average 

d) poor 

e) unacceptable ^ 
•Mean » 2.53- 

48. Ancillary activities: 

a) outstanding 

b) good - . . "'^ 

c) average 
dj poor 

e) ynacceptcible 
Mean = 2.47 

■ ' ■ 

49. The videotaped TV programs: 

a) outstanding . 

b) good N ' . ■ • 

c) average 

d) poor 

e) unacceptable. . 
.Mean = 2.52 



96 






460' 




40% 


522 




45% 


55 


• 


5% 


17 




' ""^ 








• 

' 88 




9% 


366 






395 






62 




1% 


20 




9 














112 




m 


461 




4U 


484 




43% 


54 




5% 


17 




■ 2%- 






' 1 > 


127 




. 11% 


445 




39% 


454 




40% 


93 




8% 


29 




3% 



49' 



TABLE 18 - CONTINUED' 



Item # 



Content 



Frequency Percentage 



50. Follow-up activities: 



a), outstanding 

bj good 

cl average 

d) poor 

e) unacceptable 



Mean = 2.52 ' 
51. On-site reference materials: 



a) outstanding 
bj' good • » 

c) average 

d) poor 

e) unacceptable 

• Mean = 2.62) 

52. The site monitor: 

a J outstanding 
, b) good 
.cj average 

d) poor 

e) unacceptable 
Mean » 2.11 

53. Specific canments: 

a) yes , 

b) ,no 



81 

473 

502* 
56 
18 



114 
367 
457 
53 
48 



287 
'507 
302 
39 
11 



34 
1039 



m 

5% 

z% 



11% 
m 
m 

9% 

4% 



1% 
16% 
3% 

n 



97% 
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TABLE 19 

SITE MONITOR'S RATINGS OF. LEARNING ACTIVITIES 



Activity Mean- s.d. , 

: — : : - x 



Tel e vised Lecture s- — : 

Overall rating I • . . 2.08 • ^.79 - 

Content \ ^ ^ l.'SZ v J. 08 • 

• Quality of presentation ' ^. ■* , g ^ 
Student Reaction 2.33 ' ' ^.89 

• Relation to other unit activities 2.42 .79 

. / • ' ' ^ ' 
Televised. Seminars 

Overall rating 2.17 - v , ^72 

Content 2.17 / .83 

Quality of presentation • * 2.42- .90 

Student reaction -» . 2.50 -IJ)© ' 

Relation to other unit activities , 2.67 ".65 

Ancillary Activities 

Overall rattng 2.25 .45- 

Content 2.17 .58 

Quality of presentation , 2i63 " .64 

Student reaction . '2.42 .67 

.Relation to other |init activities . ' 2.14 • .71 

• . . * 

Rating' Scale; 1 - generally excellent in that category 

2 - excellent at times f 

3 - acceptable ' , T - (X 

4 - weak at times 

' 5 - generally unacceptable • 



5i 




42- 



How tdoes th'is''^cburse compare with the previous course? 



< 



1/ 



> 



.'As in the earlier DPRI course, these students showed a significant " 
:3a4n on the cognitive achievement measures from pre- to post-tests. In 
addition? the percentage of correct items was similar for each course. 
During the earlier course the peVcentage of items correct incrpasAH from 



49% to 71%. ' During the* current course the percentage increased from 48% to * 
between 64% and 76% depending on the course option selected. 

As with the earlier course, there were, no significant gains in * 
attitudes from the pre- to posttest measure. The pretest attitudes, 
however, were positive is they were during the earlier course, making it more 
difficult for signicant change to occur. 

As with the earlier course the ratings for the learning activities 
averaged between good and very good. The si te^ coordinators received the 
Highest ratings of all the course features at both sessions. During this 
^ourse, on-site reference materials received a lower relative rating than 
previously. Ancillary activities, however, received relatively higher 
ratings. Seminars received lower ratings during both courses, although 
the ratings were still above average. 



ERIC 



52 



Conclusions 

The DPRI course, which was offered for the th,1rd tlme^durlngr 

Spring, 1377, was completed by 164 studerHs al 15 AESP :>ites. ] 

Achievement and attitude test results were similar to these obtained 
during the earlier deliveries. Although bot^^ cognitive achievement and 
attitudes increased from the first to last session, only- the ach1evemeT\t 
gain was 'significant. Attitudes were re.lative1y positive initially, 
wKlch may explain th-e lack of significant improvement In attitude scores. 

The learning activities and methods of presentation received average 
ratings ^of between "good" and "very good" as they did during the previous 
deliveries. The videotapes, however, were rated slightly lower during this 
latest delivery. This may be a result of the more frequent technical 
difficulties -experienced. For both the seminars and taped programs, the 
most frequent suggestions for improvement were more direct statements, more 
examples; and more summary statements. 

During this delivery, site monitors received the highest rating 
cOTipared to several aspects of the course. This suggests that the role of 
the site monitor may be an integral part in 'the success of satemte 
delivered courses. 

In sumnary, this course received above average ratings in all aspects 
and although overall ratings were slightly low^ t^ for previous broad- 
casts this was attributed to technical diffioil^es and equipmeni mal- 
functions. The most frequent recomnendatlon for improvement was' the use of 
more concrete" examples and specific information. 



■ CAREER EDUCATION IN THE ELEMENTARY SCHOOL , 

Introduction ' • 

The Career Education, in the Elementary School (CEE)' course has been' 
delivered by AESP 00 two occasions. The jresults of the Sunnier 1974 broad- 
cast„are presented in AESP Technical Reports #7 and 9. This report presents 
the'r^^ts of the second delivery .of CEE during the Summer of 1977. 

Overview of Course , 

The CEE course surveys the major principles-, concepts, and practices 
^of career education in an elementary school setting. ''Specifically, the course 
is designed"-to -enable teachers to develop caree> education units that ^an be 
integrated into the traditional subject areas at each. grade level and to 
sei}ve as' leaders in the development and implementation of career education 
programs in their school systems. 

.Structure of Course 

-? — - , ' . ♦ 

Dr. Clayton Onivig, Associate Professor of Vocational Education at the 

University of Kentucky was -the instructor for the course. 

The CEE course included the following components:* 

,1) Thirteen halfrhour videotapes; 

2) Four live seminars; 

3) Ancillary materials and activities. 



* 



Four-channel' audio reviews which were used during Jthe previous 
delivery of the, CEE cpdrgg -were eliminated from this delivery due to low 
ratings. . ; • s 
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' The course consisted of n sessions. Participants normany viewed 

» , »♦ ■ - ^ . » 

two tapes during each sessloTTland completed the associiated ancillary 
activities. Participants participated in live interactive seminars during 
three sessions., In addrtion to participating* In the seminar's, these sessions 
included viewing-.one v^^Ews and completing the corresponding ancillary 
activities. Three seniester hours of ^aduate credit was awarded upon 
completion of the course, 




Course Conteriy?nd -Objectives 

. Several objectives ^re sped fied/^as intended outcomes of the course: 
^ ' ^ ' " / . *■- ' 

• . .1) comprehend the major prlnciplesTand practices of career 
education in an elementar^.^school setting; 

2) recpgnize the need for career ediication in an elementary 
school setting; ' ' . - / . 

> 

3) develop a career education learning experience; * 

4) recognize the formative ^nature gf th^ career education 
concept and be aware of areas' ofpossi^e conflict among 
educators ; 

5) Inllroduce career education to an elonentary school staff. 
The topics and objectives for the twelve! uniljs were: ' ' 

* TAPE 1: THE CONCEPT OF CAREER EDUCATION 

1. deflrje career education In your own words 

2. understand ^he need for career education 

ft/ ~ , 

3. identify, fiVe basic tenets of career education 
^ TAPE 2: A COMPLETE^AREER EDUCATION PROGRAM - > \ 

identify theVra!e*of el^ent?iry education in the development 



of darken awareness 



Z. Identify career awareness concepts approRrial^ for elementary 
school students 



Hhe .first tape was introdupiory in nature and is not considered as 
a unit;. • . ' ' , * . • - ^ 
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, 3. Identify and describe the four phases of a comp.le1;e career 

• education program - • ' "t 



TAPE 3: JOB aUSTERING: A TOOL* FOR CAREER EDUCATIOp 

«V. ^understa|id the neejl for an organized 
the world of work ' 



system of "ordering 



« 

■ A 



■ 2, identify th,ree basic ways a classroom tecidher can clu5.tgr 
or group job information ' 

3. identifytwo basic functions that clusters can serve for -a 
classroom; teacher • « 

4. 'understand how the elementary school teacher, can use fitusters 
as a tool in infusing career education experiences into his' 
,or her classroom. . ' , 

TAPE 4: INTEGRATING CAREER .EDUCi|TIQN INTO THE CURRICULUM * 

1. identify the 3;"Bas1c ingredients" of a career education 
leamittg experience ' • ' , , 

2/ ^understand the importance of "^career development concepts 
fn -5 rareer education leapning experience 

o 

, • • 3. interrelate subject matter objectives and career education 
objectives . . 

^ TAPE 5: TOTAL CURRICUL|M INTEGRATION \ ' ^ 

^ ^ 1. plan, teach and evaluate^a career education learnijig 

^experience \ • ^" 



. understand the fundamentals of cuj^riculum integration 

TAPE 6: THE COLL-ECTION AND UTILIZATION OF INSTRUCTIONAL MATERIALS 

^ -A . ' ^ \ ' \ 

1. puravide for individual differences and interests in the 

pTOnning-and preparation of bireer education inat^ials 

2. ^ capitalize on areas of high sttldent "interes-t or promo' 
' ^ student interest through the use of individual and/or 

small. group activities 
" , •' - ^ . ' • 

TAPE 7:' COWWNITY RE50l|RCES 7 . 

. . -1. recognize the .effect preschool Values 'and the home environ- 

fv ^ - ment have on an individual's career davelopnjent ' ^ ■ 

.2. recognize the need for parent, coinnunity, and teacher- 
cooperation in career education « 

. 3i be aware of the wide variety of community resources 
V available to classroom teachers 

ER?C ■ . -■ ■ • 55 - \ . 




0 % 

.4, plan, teach, find evaluate 9 career education learning 
- ' experience iqvolving the use of a resource person. * 

TAPE 8: IMPbEMENTATION STRATEGY : - 

T. identify roles of the various school persoinnel in ah 
^. InfTlementatfon strategy for career education 

2. identify several of the major approaches to inservice- 
"training for career education' * 

3, plan a model for inservice training for your school system 
TAPE 9: ATTITUDES ABOUT CHANGE PV 

1. identify current attitudes about .educati^mai change 

2. identify atti^des, both pro and con, about career education 

3. diScuss care^ejlucation in relation to curriculum relevance 
TAPE 10: DEALING WI/h EDUCATIONAL CjlANGE " 

1. - identify currenj^iJros and cons regarding educational change . 

2. identify^rufrent pros .and cons about career education 
TAPE 11: SPECIAL YnTERESTS AND CAREER EDUCATION ' ' . 

1. identity current educational -problems voiced b)f special 
interest grouJ>s . - - ^ 

2. identify the^ stereotypes you place on certain interest groups 

, unders.tand the- approach of career education toward special 
' interest groups^ - • . * 

~ ^ ■ . ' • ^' 

TAPE, 12: THE llEWARDS OF A COfffREHENSIVE CAREER EDUCATION PROGRAW 

. . 1. identify the rewards of- a compreTiensive^^jg^r education 
. program 




• state ^ three major points which, indicate the necessity for" 
.'^ • career education.. . ' ' ' 

• • ^ ^ . ' 

Jn addition to these taped progr^».,all students participated in 

fotfr^l1ve,Jnteractiye seminars. These seminars enabled participants to^ 

interact Wi$h experlir in career education instruction: 



\ . • • . ... 



• Individual -and group developnierttal arid follow-up activities 

designed 1m supplenent the tapes were included in the ancillary materrals 

provided each participant. The developmental exercises were designed to 

Ijelj^the student question and think about the concepts of caneer education 

while the follow-up activities consisted oi; actual career education ^eamlnj 

' experiences .for the^. student- to try^tn his or her own . classroom. 

Each participant purchased the^llowlng instructional materials^j^ 

fioyt, Kenneth B., et al. Career Education and fthe Elementary School Teacher. • 
Salt Lake City, Utah: fllympus Publishing Co., 1973. Cost $5»95. . 

Ancillary Materials- for Career Education in the Elementary School, prepared 
by AE5P Resource Coordinating Center.- Revised ed.', 19771 \ Cost $6. 50 

, y Method . ■ ■ ^ 

Subjects ' . ' 

■ • ^ ■ ' ' ' / - ) • 

Complete data (all cognitive and affective pre- and^'^posttest measures) 

• were available ori 72 of the 109 persons- who participated in. the CEE course 
offered during Sdfeier 1977. Thirty-eight of ^hese^tudents were enrolled atj ' . 
nine AESP sites. Thirty students at Norton Teacfier Corps, and four students at 
Tennessee Teacher Corps' completed the course with )he videotapes' and 
ancillary materials but did not participate via satellite: The number of 
participants at each site 1s presented in Table. 20. ' . ' 

-Participants completed a cbmbined attitude and,backg^und qi^.estionnaire 
during the first session. This questionnaire consisted of two parts. The 
first part dealt with attitudes towards dareer.educajtion and the second part 
with background information on the' participants. This background ^information 
is summarized In Taljle 21. 
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^' TABLE- 20. 



OrSTRIBUTION OF PARTICIPANTS BY SITES 
(Complete Data tases Only} 



Sitet ' - - Number orTartfclpants^ 

— - — - — — — — — 



10 . Huntsvllle 




6 


' 11 Ralnsvllle * ^ / ^ 




, '3 


' 12 Suntersvllle " . 


• 


* 3 


• 15 Tennessee Teacher Corp%. 




4 


16 Tazewell \ . 




3 


20 Nortpn ' .S'- 


\ ^ . 


2 


23 Norton Teacher Corps 


V , 

■ / 

• K 


30 


26 McHepry. 


8 


- ' 27 Keyser. ' • . 


1 


4 


35 J^redonla/^ 

♦ /■ 




' 6 


36 \)lean* «* 




3 


Total .- 




72 



^ Procedures and Instrumentation' ./ ^ 

The CEE course Was evaluated, using several- assessment instruments 
that were comple^ by coui^||)artici pants and. by the site monitors. Thpse 
instruments are. described below. , 

Taide 22 presents the el ass meetli^^ schedule, the activities associated 
.• with each session, , and the evaluation forms completed during the course. / 

Coqrtitive^c^iievemetfc Tests. During the first. class session participants 
completed a pretest of 30 items which were randomly selected from the midterm . 
and posttest. This test was designed ^o measure their knowledge about career 
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TABLT 21 



SUfWARY BACKGROUND INFORHAHON FOR PARTICIPANTS 
' • -^COMPLETING SUHMER, }97l CEE COtmSB 



Item 



Resporises 



Frequency Percentage 



Sex. 



Cotnsunlty In which you 
teach 



Age at last birthday 



'Position during 
1976^1977' academic ? 
' year • [ 



Grades you woric vrf th 



Experience teaching 



Undergraduate GPA \ 
' (4: jJolnts * A) 



>!ale \ 
Fanale , « " 

No response 

Rural . * 

Urban " ^ 
Suburban > * 
No response 

21-30 
31-40- , 
'41-50 
51-60 . 

61 or over - 

No response 

cuss.™ tUaer ' 
School counselor 
Special education teacher 
School administrator 
Other 

, Elementary - all grades 
K 

1-3 
4 w 6 

7-: 12 ' . ■ 

No response ' . 

1 year or less 
•2-4' years"' 
5,-8 years . 
9 ? 15 years 
16 y^rs or more . 
No response 

less than 2.50 
2.'51 - 2.75 . 
2.76 - 3.25 
3.26 - 3.50 
.3.51 - 4.00 ■ ■ 
No response 



60 



24 


33.5% 


48 


' . 66^5% 


0 


0.02 


.63 


1 

87. 5X 


3 


'4.0% 


6 


8.52 


^ 0 


O'OS 


32 


' ,44.5% 


20 


28*aS 


10 \ 


, 14.0* 


10 


r 14.02 


0 


" 0.02 


0 


A 


X 

40 


55 p 5% 


u 


ft M ' 


1 


1 .5% _ 


3 


, 4.0% 




N39.0% 


13 


l8*0% 


2 




6 


8. 5% 


33 ; 


'46.0% 


10 




0 


0.02 


16 • 


"22.^2 


25 


34/52 . 


12 


. .16.52 


11 


1^52 


8 • 


11.02' 


' 0 


0.02 


5 


7.02 


9 


12.52 




y^2.02 • 




28.02 


^ 8' 


, 11.02 


■7 


■ 10.02 


* < 


• . m. 
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TABLE 21 CONTINUED 



Item 



Response 



Frequency Percentage 



•Graduate SPA 
(4 points « A) 



Last degree completed 



less than 2.50 


0 




2.^- 2.75 


2 . 


3. Ox 


2.76 - 3.25 


11 


15 ..51 


3.26 - 3.50 


15 


21. OX 


• 3.51 - 4.00 


'20 


28. OX 


No respbnse 


24 


33.5X 


Hl^gh school diploma 


10 


14. OX 


Baccalaureate 


47 . 


65. 5X 


Master's ^ 


11 


15. 5X 


Specialist 


1 


1.5X 


* Doctorate , 


0 


. o'.ox 


No response 


0 . 3.,.., 





education philosophy and Implementation., After the sixth unit, studel^^ 
completed a midterm examination. This test was composed of 30 Items, and 

' - - , ♦ • ^ 

corresponded to the <:ontent Included in the first 6 lessons. During the ' 

«" 

las^ class session, a posttest was administered which consisted of 30 
items that reflected the content of the la^t 6 unit^ These cognitive , „ 
tests were used to measure learning that occurred as a result of participation 
in the CEE course. During the previous CEE course, unit tests as well as, 
pre- and posttests were administered. Thes>,un1t tests were eliminated from ' 
the Sumner 1977 course delivery. For more information about unit exams see 
AESP Technical Repdrt #9. - ^ 

Attitude Questionnaire. Students c^ipleted the attitude portion of 
.the Combined Attitude and BackgrounV^ue/tionnaire for CEE on a pre-post 
basis. This questionnaire consisted^ of 25 items which were answered on a 1 . 
to 5 scale where 1 indicated strongly disagree and B Indicated strongly 

a|ree. This instrument was designed to assess the student's affective attitudes 

■ ■ I 

towards career education theoT7, concepts, and philosophy For purposes of 
scoring, mean's for each item as well as all items combined were computed. * 

■ ■ • ' 61 ■ ■ 



TABLE 22 - 
SCHEDULE OF INSTRUCTIOHAL ACTIVITIES 



i 



Session 



. Date " 



Activities 



Evaluation* 



TV 

Programs 



SeiirKgrs 



Ancillary 
Activities? 



7/6/77 



Pretest, Attitude and^^ 
Background Question- 
naire 



2 


7/7/77 


3 


7/12/77 


4 


.7/13/77' 


5 


7/14/77 


^6 


7/19/77 


7 


7/20/77 , 


8 

• 


7/21/77 


9 

10 ' 


7/26/77 . 

\ 

7./27/)7 , 


11 


7/29/77 







Midterm examination 



■Overview 

1 & 2 

. 4 & 5 
6 
'7 
' 8 
- 9 
10 & 11 
1*2 



X' 



X 

X; 

X 

X 

X 

X 

X 

T( 

X 



Final elimination. 
Attitude Test, < . 
Summary Evaluation ^orm 



*I'n addition: A Unit Evaluation Form was completed by all participants 
-after each session. , „ ^ - ■- ^ ' ■• 



EQulpment Report and Student Satisfaction* Form. All site monitors 
completed the Equipment Report and Student Satisfaction Ponn following each 
(class sess1,on. • This form wa^ used to. report ^hnlcal functioning of the 
^uipnfent, audio and video reception, and the site coord1nator|s perception 

--of students' satisfaction vrith, the taped programs, the live, Interactl^ 

■ seminars, and the ancillary activities. 

Evaluation Rating Form. After each .unit, participants completed a 
5-1ten evaluation rating form designed to measure their reactions to the 
videotaped programs and the ancillary activities. Participants responded to 
eacff item oh a 1 to 7 LI kert type scale and were ehcouiWed to Include 
jjarratlve comnen:^ about their reactions. This 'form r^laced the Televised 
Lecture Questionnaire and the Laboratory Activities Questigjinaire used duHng 
. the earlier CEE* course. ' ^ , 

Seminar Evaluatiorfonn. Following each seminar, participants 
. completed an's-ttem seminar evaluation form designed to assess their reactions 
to various aspects of the seminar including the moderator and the^seninar^ 
guests. This form.replaced the Seminar Questionnaire used during the earlier 
CEE course. , . , ' 

Suninary Evaluation Form. ^ During the last session, participants 

completed the Sinnmary Evaluation Forra^ ThisJ^strument was used tfe "measure 
the .participants' satisiPaction with the various components of the Murse. 
as compared to a traditional instructor taught course. The students also 
responded to several questions related to the information 'they received 
during the course and areas of- interest for future programs. 'This form . 
replaced the. Instruction Fee'dback Questionnaire used during the earlier 

r • , ' 

CEE course. I 



< 
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Results 

I T-^ 

The evaluation of the CEE course is foclised on the four research 
. quiBStlons presented In the Introductory section of this report. The answers 
. to these questions are presented beTow. 

'*> 

How were participants' learning and attitudes affected? 

A pre- to posttebt gain analysis* was uSed as a basis to ascertain 
the amount participants had learned and the amount of attitude chanjge that 
1 occurred as a result of participating in the course. The percenl^age 
W • correct of the cognitive pretest and the combined midterm and posttesi, and 
the average rating on the 5-point scal6 on the 25-item attitude pre- and 

s 

posttests were used for the analysis.^ The pretest consisted of 30 items 

. "\ - ^ ^ ' • ' 

randomly selected from the mldtenn and posttest. The midterm and posttest 

each consisted of 30 Items. 

. The analysis of variance design was -an 11 site by 2 administrations " 

design. Both achievement and attitude were included. in the analysis, thereby, 

making a multivariate analysis of variance (HANOVA) design appropriate. 



Procedures described by Finn (1968, 1969) for repeated measures designs 

were followed. . . > - ' • 

The results indicated a significant difference for sites^(multivariate 

F » 3.94, p <.O001), for administrations (multivariate F » 102.44, p < .0001), 

and sites" by administrations (multivariate F «'2.'30, p <-.003). The multivariate 

results are presented iri Tabla 23. The differences for all factors occurred 

' ■■ ' . ' ' " 

only oh the cognitive yarfabTe_^(see Table 24). This means that a differential 

gain In knowledge" of career education concepts occurred among sites. As is 
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TABLE 23 



MANOVA FOR^PRE- AND POST-ACHIEVEMENT AND ATTITUDE MEASURES 



Source 



1 



d.f. 



Multivariate F 



Between Subjects 

Sites 
Within Subjects 

Administration- . ' 
^ Sites by Administration 



20,120 

2,60 
20,120 



^..94 

p 

102.44 
2.30 



.0001 



.0001 



.003 



TABLE 24 



UNIVARIATE AND^STEP-DOWN F's FOR PRE- AND POST-ACHIEVEMENT 

AND ArriTUDE MEASURES 



Source 



Univariate F 



P< 



Stepdown F 

c_ 



P< 



Sites • 

Attitude 

AchievOTent 
Administrations 

Attitude 

Achievonent- 
Sites by Adm-inlstratiows 

Attitude 

Achievement 



1.69 
6.34 

1.19- 
/ 203.94 



1.34 

3.45 
-A— 



.103 
.'0001 

.28 
.0001 

.23 
.001 

m 



1.69 
6.88 

1.19 
199.8a 

1.34 
3. '42 



.103 " 
.0001 

.28 
.0001 

.23 

# 

.001 
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reflected "In their average score^ (pretest -average » 52.514 ?nd posttest 

average » 75.292), the participants significantly Improved their knowledge 

/ • :• '■■ 

-«f career education concepts from pre- to posttestlng. 

-^tle no significant -difference occurred, for t.he attitude variable* 
the pre- and posttest means were 4.00^ and 4.122 respectively. (For item 
means see Table 25). These scores indicate a relatively pbsitivft attitude 
toward career education concepts existed at the beginning of the course which 
was maintained at essentially the same level throughout the course. 

Because two Tisacher Corps sites (Virginia and Tennessee) used video- 
tapes on site, a separate analysis wa? conducted to compare their* performance 
to the p^ormance of individuals at sites that received the programs via 
satellite. The results of this analysis are presented in Table 26. The 
results indicated a significant difference between the Virginia Teacher Corps 
site and all other ?1tes and between the Tennessee Teacher Corps site and 
all other sites. The univariate analyses are presented in Table 27. The 
results indicated that the difference between the. Virginia site and all 
other sites occurred only fdr the attitudinal variable". The Virginia group's 
attitudinfl score changed from 3.70 to 3.97, while §11 other sites showed a 
change from 4.42 to 4.03 from pre- to posttesting. These results indicate 
that the pattern of changfe for Virginia on the attitudinal variable was 
significantly different than the pattern of change at all other sites. 

As can be seen in Table 11 ^ the results indicate that the difference 
between the Tennessee Teacher Corps site and all other sites can.be attributed 
to the cognitive variable. The Tennessee group-^ifged from 29.0% to 55.2% 
corrects on the cognitiye measure, while the. satellite sites changed from 53.3% 
to 77.4%. This difference -in performance indicates that while participants ' 



TABLE 25 ■ > 
ITEM MEANS FROM AHITUDE SCALE 



. Pretest Posttest 
Item • 



Mean S.D. ^ . Mean S.D. 



1 


4.44 


.96 


4.50 


1.06 


2 


■ 4.39 


.99 . 


4.46 


1.13 


3. • 


•' 4.50 


.92 


4.47 


1.01 


• 4 


4.36 


. ,94 


4.49 


1.10 


5 


4.13 


• .90 


4.11 


1.00 


6 


3.47 


1.01 


3.39 


; .99 


. 7 


3.28 


• ,.91 


. 3.4a 


.99 


8 


4.14 " 


1.18 


4.00 


1.23 




4.32 


.98 


4.14 


1.00 


10 


4.22 


.89 


4.15 


1.18 


n 


; 4.08 


.90 • 


4.00 


K08 


T2 


4.33 ' 


.96 


4.36 


1.13 


;i3 


. . 3.85 


1.07 


4.11 


1.22 


14 . 


3.81 • 


1.22 


4.26 


1.28 


- 15 


3.15- 


1.03 


3.38 


1.16 


16 


3.97 


1.32 


■ 4.31 ' 


1.11 


17 


4:io 


.92 


4.T7 


.98 


18 


3.93 


.94 


3.93 


.92 


19 


3.96 


1.05 


4.11 


1.03 


20 


4.17 


.98 


4.35 


1.02 


21 


4.21- 


.89 


4.32 


1.10 


22. 


3.94 


.98 * 


4.08 \ 


' .96 


23 


3.68 


1.19 


4.07 


1.05 


24 




.84 , 


,4.31 


.94 


25 


3.60 


1.43 


4.17 ' 


1.22 


Note: 


5-po1nt, scale - 1 = 


disagree, .5 = agree 







at the Tennessee site showed an improvement from pre- to posttesting, their 
overall "performance was significantly lower than the performance at the other 
sites.* 



*It shptild be noted that these results are based on only those four 
students at the Tennessee ?eacher Corps site who completed the pre and post 
attitude measures and the pre, mid, and post cognitive measures. 
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TABLE '26 



-MANOVA FOR TEACHER CORPS SITES VS. SATailTE SITES 



* , - Source 




d.f. 


Multivariate F 


P<* 


r"S/ ^- '^Virginia Teacher Corps sites 
""vs. all other sU^s 




2,60 




'5.38 ■ 


. .007- 


Tennessee Teacher Corps sites 
, vs. all other sites 


\ 


2,60 




11.22 


.0001 


^ ^All AESP Suites 


s 


76^.120 




3.09 


'.00J03 


i 


\ 

- TABLE 27 






• * 


UNIVARIATE AN|) STEP^DOWN F's FOR .TEACHER CORPS SITES VS. SATELLITE SITES 


Source , Univariate 




P< 


• 0- 
Step-Down F . 




Virginia Teadier Corps ' 
vs. -all other^sites 


* * 








> 


Attitude' 


9.01 




.004 


9.01 


.004 


* 

Achievement 


0.45 




.51 


1.65 


.20 


' Tennessee Teacher Corps 
ys. all other |ites' 








• 


1 


- 'I ■ 
Attitude'* . 


. .12 




,.64- 


.21 


.64 


" \ 

\ Achieveinent 


• 

20.46 




.0001 


22.15 


.0001 


' ' - All AESP Sites 






• 






Attitude 


.96 




-.47 


.96 


< 


Achievement 


5.31 




.0001 


5.78' ' , 


.0001 
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In summary, ^differential gains on the cognitive measure occurred among 
, s1tes,^and the participants showed. § signflcant gain In their knowleidge of . 
career ^ucatlon ^ncepts overall. TTr'elatlveTy positive attitude toward 
career educ^^foJl concepts y(as manifest at the beginning of the course and . 
no signlftcant cknge in thfs Jevfl occurred throughout the course^ The 
.results also Indicated^ that petrtldpant performance wdaj^iffepentlally, ^ 
affected by^the use jjf videotapes vs. satelUte-dellvi^^ programs? However, 
djie to th§ preliminary nature tff these^ findings, .no,def^n>;^e conclusions 
can yet be drawn about th1», effect. *: ^ 

. . i ■ ■ • ' . ' . ' ' ' ' , * ' ' ^" 

How effectiv^^^w&re the learning activities and methods of presentation 
aftd how m1(fht they be Improv^? ^ • ^ 

The.%valuat1on rating form which was completed after each unit was"' 

used to measure" the' ef fec^venes.S: pf the video tapes and the associated 

... ■ ' . « 

learning activities. Part4cijfants useid a 1 to 7 Liker^ type. scale where 
1 = strongly agree and 7 « strongly disagree to rate several aspects of each 
session. The results were analyzed separately for AESP sites and Norton ' ' 
Teacherv^orps. since Norton did not view the program via satellite. 
Videotaped Television Programs. The parti cipaq ts resp onded to • 



the questiohq^of' whether the videotapes associated with each unit provided 
them with useful information. Both AESP sites and Norton Teach^ Corps agreed 
with this item. The ratings however, were significantly mo^-e positive for 
the AESP sites. These results are presented in Table 28. 1^, 
o. Coranents were g^erally positive, alttTough several. il0lcated .the tapes 
wer^ sometimes repetitious^ and went thto too much det^tll: » < 

-'the videotape thoroughly covered-the material • - • 

-> very good - : . ^ ^ . 

*- I could apply the videotape in my "vcl ass room- ' ^ 









t 




1^ 




, % 




60 


- 








' 1 

* 


' TABLE 28 . 

« 




* • 

r 
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'AVERAGE RATINGS OF VIDEOTAPES FOR EACH UNIT . - 










V 








^ ♦ 


AESP Sites* • , ' 


Norton' Teacher Corps 












k 




Mean 


. S.D, * 


Me^n 


S.D. 




/ 

1 ' 










• 

r' 


2" 


2.61 , 


l.OB 


2.56 


..98 








1 mOO 


2.66. 


I'.IO, 


m ^ 


• 4 




QC 


2.61 


1.12 


% 


5 






3.29 


1.31 






2.12 . ' . 




2.64* 


1.22 




7 


2.26 


1:09 . ; 


2.71 


.77 




8 


2.22 


1.07 ' 


a.00- . ^1.10 


i 


•9 


2.29 


. .85 


2.92 


1.06 




' 10 


' 2.40 ' ' ' 


1.19 


2.90 


1.03 




♦ n 


2.12 


. .92' 


2.96 


.96 


■r , 

f ' 


12 ' 


• 2.27 


1.41 

• 


3.19 • 


1.58 




Overall , 


2.27 


1.14 


2.83^ ■ 


1.06 




N = 38 




fi= 30- 


f 




"♦Includes all sites except Norton ^Teaoher Corps and Tennessee Teacher CoV^ps . 




< * • 


useful id^ds to implement career ectacation- 


* 








enlighteniw 




* 








we're getting too nfuch in de^fth piaterial for the time we have 








classroom examples were excel 1 eat 










too much repetition. 








- 






1 A 
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f 

* _ 


t 


- • * 


• * 
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• Ancnibry Activities . The participants rated the ancillary activities 

on several criteria.' The results of the ratings for AESP sites are presented 

in Table 29 and the results for the Norton Teacher Corps, are presented in 

Table 30. Although, =the ratings for Norton 1'eacher porps were generally 

positiv^, the AESP sites ratings were significantly more positive. The 

Norton Teacher Corps ratings were lowest for the cat^ory "adequate time was 

a^lovSed to complete the^ancillary activities" suggesting that perhaps other 

activities such as setting up equipment took up cj^ss time^ 

In general the participants' cdmrnents regarding the ancillary 

activities were positive: 

- these activities can be taken back to classrooms 

- lengthy although usfeful .^.^^^ 

- will use some' of these activities in classroom 

- some directions were confusing • - • ' , 



In addition Norton participants, indicated that some activities were difficult 
to complete with- so large a class, ^' > 

Seminars* The Seminar Evaluation Fonn was used to measore stiKJents^ 
perceptions of each seminar. These results |ire combijjjed for the four sessions, 
and ar e pr e sen te<MfHFafrfe-^. — Thfr-maior4ty^-trf the participants we r e s ' atj s-^ - 
fied with the seminar guests and the moderator. The overall rating af the 
seminars. Was between "verV good" and "good" (average rating = 2.35)^' although 
only aboj^t one half^of the stQdents were completely satisfied with the ^hs^ers '\ 
they received and the seminar formal. "The most frequent suggestions for 
Jmpirovement were more direct answers to the questions and a sho^t suiranary of 
prior course content pretcedf^l^ the seminar. The following' comments elucidat^ " 
the 4)artici pants' reactions: - , 
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"TABLE 29 



AVERAGE RATINGS FOR ANCILLARY ACTIVITIES fOR EACH 'UNIT FOR AESP SITES 



Unit 



. 1 . 
2 
3 
4 

"v. 

5 

1 . 

8 

9' 

•10 ' 

Il- 
ia 



Instructions 
cliear 



Adequate time 
to complete 



Practical' and 
applicable to 
Classroom 



Mean 



1.76 
2.46 
2*. 19 

. 2.91 
3^15 
2.44 
•2.47 

^.52 
;2.35 

■ • 2.42 
2.22 
2.34 



s:d. 



•ftean* 



S.D. 



Mean 



3.D. 



1.02 
.1.46 
.97 
1.81 
1.52 
1.43 
1.37 
f.50 
1.3 
1.53 
1.45 



2.18 
3.15 
2.35 
2.75. 
2.93. 
2.19 
2.32 
2.08 
2.09 
2.02 
1.92 
■i..-Q9 



1.6.0 

2.16 

1.47 

1.43' 

1.80 

1.40 

1..46 

1'.16 X 

1.03 

• > 

i.n 

1 .05 

.1.11 



2.06 
2.37 
2.4a 
2.60 
2,38 
2.15 
^.33' 
2.27 
2.20 
2.43 
2.30 



1.19 
1 ^25 
1.34 
1 J9 
1.11 
1.06 
1.33 
1.19 
kOO 
1.12 
1.25 




*Overal 1 



Mean 



jL22 i 1.17 



1.81 
.2.12 
2.19 
2.42' 
2;37; 
2.07 
2.14 
,2.05 
2.05* 
2.29 
2,05, 



S.D. 



i^22 
1:23 
1.14 
1.05 
1.00- 
1 .00 
.99 
..88 
1.14 
.97 
V-'nn. 



Overall 2.47 



T.48 



2.33 



1.45 



2.32 

, 1 



1.18" 2.14 



1.Q5 



- answers not detailed . • ' 

- speakel"s weire well i-nfonned and experienced in- career education 

- the paneil should give mdre direct: answers tQ questions 
-'panelists sfrould spend more time on some questions. * - 



mo. ■ 
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\ TABLE 30 • 

AVERAGE -RATINGS FOR ANCILLARY ^ACTIVITIES' FOR EACH UNIT FOR NORTON TEAgIjIeR CORPS 



'Unit 



If' 

2 ■ 

3 
4- 
S 



' 7 

» 

8 
9 

n 

t 

Overall , 



Instructions 
were s^atr 



Adequate time 
to complete 



Practical and 
applicable to 
„ Classroom 



Overall 



Mean S.D. 



Mean 



S.D. ' Mean 



S.O. ' V Mean 



S.D, 



2.81 
3.11 
2.93 
3.20 



".79 
.« 

.96 
' 1.'23 

...1.08' 



3.06 
3.06 
3.10 
3.29 
3.22 
3.23 
3.28 

3.09 



.,88 

•V 

1.22 
\96 
-.90 

1.02 



3;38 
3.13 
3.25 
, 3.37 
4^00 
3.60 
, 3.00 
3.72 
3.44 
. 3.36 
» 3.90, 
- 3.50 



1.41' 
1.30 
1 . 14 
1.39 
1.58 
1.65 
^ !63 
1.13 
* .92 
1.14 
■ .97, 




2.94^ 1.20 * ^.73 
2.94*Y7..85 '•*2.81 
2.97 ^ .''78-* . 3.00 
3..03 a'.2r 2.97 

07 > .„„U16-_mi_ 
.00 -1.^- 2.79' 



3.39 
3.37 
3.19 
3.43 



.60 



_a.4o 

_340_ 



.98 



3.46 / 1.17 



3.17 



.65 
.76 

1.08 
'98 
.82 

-1.06 

' .99 



A 



3:20 

3.16' 

3.18 

i3;18 

3.20 

3.27 ' 

3:08 



1.10 
.83- 

« 

.85 
1.25 

.97 

.78^ 
.90 
,85 

1.09' 
.'82 

*1.08j 

.99 
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« .TABLE 3V . 
SEMINAR EVALUATION FORH SUW1ARIZED ACROSS ALl SEMINARS 



^; — 

Item # Content ^ . . Frequency ' Percentage 



1. Which one of the following would have made.td- . 
day's seminar more effective? (If the semi- 

nar participants were fine, maHc option .d') ^ - - 

, - * « ' . 

a) the moderator answering the questions him- 
self without guests ' ~ ' ' ■ f ,-2 . .2% 

b) use more teachers as quests. . ' 25 . " ISX 
. c) use more prof essofrs or other experts as 

guests ' « U ■ & B% 

d) the seminar participants were fine - 125 • • • 7S% 

2. Which on{ of the following seminar formats 
might hetlNyoii think of more meaningful , 

■questions to ask? 

a) have at the beginning of the .seminar a 10** • ' 

miiujte .summary W course content covered- 



si nee the last s&nin#^' 35 21% 

b) shoW'at the beginning of .the seminar a 
short film illustrating several new^ class- 
room demonstrations of material covered 22 * 13Z 

c) Have the opportunity to use the whole sem- , 
inar for question answering and discus^on ^ . • 
rather *than spending part of; the program 

for question' stimulation . * 14 ■ , w 

d) the seminar format was .fine* 93 56% 
. eK other . ' • . 

. • - * ' 3 j . 2% 

3.. ' The 'answer^ to' the :questlons' could-have-heen 

^ .more valuable if there had -been,: ^ , ' • 

a) less discussion. of theoretical aspects ^^jf 

the question ' . ^3 "2% 

b) more^frequent use of specific classroom 

examples \. . , 18 • 11% 

c) 'more direct answers to the questi^s - 57 . 33% 

d) less repetition in the guests answers ' 12 . - 7% 
\ el 'I was very satisfied with the answers I 

• Nheard ' ' . . 81 

» ■ ' ' 

4.' 'The pace of the' seminar should be: / .... ^ 

' ^ aj much slower ' t -3 . |' 2% 

. ' b) jsomewhat slower 4 ; 2%^ 

c) the pace was satisfactory. / 126 75% 

d) somewhat- faster "23 ,17% 

e) much faster ? ; 4 ,Z%- 



TkBLE 31 CONTINUED , 



^tem # 



Content 



Frequency Percentage 



5. 



6. 



7. 



a. 



The seminar moderato/ could have been more 
•effective If he/she had: ^ 

a) kept the guests on topic better 

bj provided suninary statements occasionally 

c) kept the seminar moving at a faster pace so 
> more questions could be answered 

d) asked guests to alvp fnore^etalled answers 

e) the moderator was acceptape as fs 

React to the following statement: The seminars 
gayejTiejiL-Qpportunity to have real input. 



strongly agree" 

b) moderately agree 

c) neutral 

d) moderatel^dl.sagree 

e) strongly disagree 



React to the following statement: The Interr 
actions in the seminar wer^ of personal reT 
vance to me. 

a) strongly agree 

b) moderately agree ^ ^ , 

c) neutral ' ' ^ 

d) moderately disagree 

e) strongly disagree 

> » 

What ts your o\^er^U^ evaltiation^ of today* s 
seminar: ^t^^z* 4» 

a) excellent* - * 

b) very good , . ' ' 
o) good 

d).fair : ' v . * 

poor ^ 







n 


72 


n 


7% 


, 15 


: \ ' 9« 


'19 


m 


102: 


65% 






31 


19% 


86 


51% 


••-SI 


. 19%, 


7 


4%r 


12 


7% 


97 


• 

1 U>o 


9,3 


56% 


39 




■ 4 


/ . 2% 


4 


2% 


28- - 


17% 


•£8 


41% 


56 


34% 


•14 


8% 


1 


1% 
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How reliable was the equipment used during the course? 

As with the. earlier delivery* the videotaped programs and seminars 
*^ere broadcast via the ATS-6 system and seminar questions were transmit,ted 
• via teletype or telephone. The site monitors completed the Equipment 

Report and Student Satisfaction Torn after each session. The technical' V- 

^ functioning of the eqoipment was detenirlned by sunnarizing the rtitings of 

• - ^' >■ . . 

the audio and video signals for all sites across all sessions. .The audio 

-» • • - 

signal functioned -with arTeliability of;93X with a mean rating of 2..91 which 
indicates little or no noise. The video porfloji foinctlojied .with an overall 
reliability of 88X with an average rating of 4-.81 which means no or tarely • 
perceptib"^ distortion. 



■ m 

* What was the overall evaluation of the course? 

The Sumuary Evaluation Form and portions of tHf* Equipment Mljort and 
Student Satisfaction Form were used to evaluate participants' overaJ|l 
satisfactlq^n with the course. Six aspects 'o^* course were rated accordi-ng 
^0 the qual-Uy of useful, infomfatioir received as compared with a traditional 
instructor-taught course. 'The frequency of ratings for each item are s. 
pre^nted in Table. 32. Jhe site .monitors received the highest, rating of all, 

( the course comp'onents evaluated^ They were rated between "good" and "out- 
.standing." The following conments suggest some reasons why the monitors were , 
rated highly: ^ 

- site monitor did- an excellent job in keeping things mpving along / 
smooth!)^' ^ 

- si1*e monitor, was effective in question stimulation from our (group 

- this type of course offered could develop into an impersonal 
type of learning situation, but wUh an .interested site monitor 
this did ^ot occur.,., ' • ' 
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TABLE 32 ■ , 

PARTICIPANTS' RATINGS OF COURSE COMPONENTS AS COMPARED 

TO TRADITIONAL INSTRUCT0R-TAU6HT COURSES" ..4. 

( * 



'item # 










Content 

<> 




' Frequency 


Percentage 



1. Pre-progr^iRt preparation: 

» a) outstanding ^ 

b) good . . 

c) average 
jd) poor 

e) unacceptable 

^ Mean « 2.03 ' • 

2. ' Televised* interactive seminars: 



3. 



a) outstancPing""" 

b) good 

g) average 

d) ' poor . 

e) unacceptable \ 

Mean = 2.03 
Ancillary actlYitits: 



outstahdiRg 
good 
average 
poor 

unacceptable 



•Mean =. 2.1.3 
4. Videotaped TV programs: 

a) ' outstanding 

b) jgood 

. c) average . 

d) poTor . 

e) unacceptable 



6 

25 
7" 
0 

JO' 



10* 
21 

5^ 

1 

0 



162 - 
662 • 

0 ■ 
0 



~T2~' 




J6 


> c . 412 


9 


. 232 


2' 


52 


0 


0 


8 ' 


212 


18 


. 472 


11 


2^ 


1 


32 


0 


0 







272 
572 
142^ 

' 32 
0. 



Mean = 1.92 



^ TABLE 32 - CONTINUED 



Item # ^ « Frequency Percentage 



5. Follow-up activities: 

outstanding 6 162 

•bl good • ^ 16 42% 

a) average 16 42% 

. d) poor, « 0 0 

- e) unacceptable » .0 0 

. Mean ? 2.26 ' ' / . 

6. Site monitor: 

a) outstanding '27 -71% 

b) good 7 • 18% 

c) average,, ' 4 11% 

djv poor ' ' , ] ■ ,0 0 

e) unacceptable' . , , '0 0 



Mean - 1.40 - . - 
7., Specific, conments: * ^ 

a) yes • , ' 4 11% 

b) no ' . . • 33 89% 



All the othe^ aspects measured were rated "good." -Representative comments 
• may indicate reasons why other aspects, although rated as abovg^ver^ige, 

we re. not ranted, higher: • - . ' $ 

- ancillary activities Were„ redundant 

♦ 

* ^ - television programs were at times too repetitious of the same 
material talked about previously. 

Participants also reacted to several otffer statements int;^ended to 

evaluate their overall reactions, to the course.* Table 33 presents. these ratings. 

T^evma^ority of the participants' agreed that the course was not impersonal. 

Host indicated they received many ideas for practical application in their 

classrooms and that they planned to use the information they received in their 
• . .'^ / 

own teaching." / 



TABLE 33 

OVERALL COURSE RATINGS BY PARTICIPANTS 



~ Mean = 1.79 

^ 3. The textbook for this^ course was 'an inter- 
esting and informative supplement to the 
videotaped programs and ancillary .activities: 



Item # ' . ■ • Frequency • Percentage 

' % 

1. I did not feel the technology used iji course 

delivery made it impersonal:- . * 

;aj strongly, agree 14 362 

b) moderately agree . ^ . ' 19 492 

• c) neutral ' 3 . .&2 

d) moderately disagree , ' * 1 . . 2% 

e) strongly disagree - 2 '5% 

Mean = 1.92 * ' , ' . ' 

''2. • It would have been very difficult* to ^get the - 

information provided in any' other way: ^ 

aj' strongly agree M ^ 17 45% 

b) moderately agree . , 14 - 372 

c) neutral '5 132 
dj mdderately disagree. . Z 52 
e) strongly disagree- 0-0 



a) : strongly agree ' 14 372 

b) modoratoly a gree—-- ^ 13— - —3^%- 

c) neutral * . 5 1,32 
dj moderately disagree ^ 6^ " 162 
e) 'strongly disagree „ . '0 0 

Mean ».2.08 * ^ • • 



4. ^The course presented many interesting Ideas * 
for practical application In the classrocmis: 

strongly agree ' 26 682 

moderately agree 10 ^262 

neutral . " • ' 1 . 32 

moderately disagree ; • 1 32- 

strongly disagree ' " 0 0 



• Mean =n.40 *- 



10 . 



TABLE 33 - CONTINUED 



Item # 



Frequency Percentage 



5. 



6. 



7. 



What effect do you think information contained 
in this course will haye on your teaching? 

a) has very little or no relev^ce 

b) would like to use but probably won't . 
be able to " 

c) would like to use" but don't understand 
enough 

d| plan to use 

e) already know or am using 

The .guidelines I followed in completing the 
ancillary materials were: 



1 
3 
1 

33 
0 



) clear and easy-to-follow 
) generally understandable 
somewhat confusing, 
very difficult to follow 



14 
15 

5 ' 
4 



Would you be interested in participating in 
programs of this type in the future? 



a) yes 
Jj) no 



8* Primary reason fof* enrollment in this course:- 

a) need 3-hour^ credit 

b) i nterested in qareer education 

c) caregr^Hucation mandate 

d) other 

9. Which course format do- you prefer? 

a) S^credit hour course 

6) short course with 1-hour credit 

c) one-day inrservice workshop 

e) other ^ - 

• 

10. Do you prefer to meet: 



33 
5 



14 
24 



\ 



a) 
b) 
c 
d 



once a week for 4 months 
twice a week for 2 months 
more than twice a week 
other 



V 
1 



31 
1 
6 
1 



U 
17 
1 
1 



3% 

^% 

3%, 

B7% 
0. 



37% 
39% 
\3% 

m 



m 
^3% 



35% 

60% 



3% 
3% 



79% 
3% 
15% 

3% 



m 
m 

3% 
' 3% 



Particfpants responded -to several Items designed to determine their 



in future programs.. The majority said they would be interested in 

participating in future 3-credit hour courses and indicated that they had ; 

enrolled in this course primarily because they were interested in career 

education. Areas of interest for future, programs frequently mentioned were 

special Education, health education, adult education, and classroom management. 

Using a 1 to 5 Likert typS^scale where 5 excellent and 1 « poor, 

the site moni torts rated student satisfaction with the tapHi programs, the live 

seminars, ^nd the ancillary activities following each class' session. The 

taped programs and the live seminars both received 4i^ge ratings of "very 

good" overall. The mean rating for the taped programs was 4.09 and for the 

seninars 4.08. The ancillary activities'^ were rated between "good" and 

"very good" with a irean rating of 3.61. i 

« 

I ■ - * 

How does this course compare with the previous course? 

The students participating in the earlier course delivery showed a 

pre- to posttest gain in cognitive achiev^nt as did the students enrolled 

in the Summer 1977 course. During the previous course, the percent of items* 



answe^red correctly TrTcreased from 68Z tcTsoZ from pre- to posttest whicTi was 
a \p» gain. During the 1977 course the percent of. items ansv^red correctly 
ii^^reased by 182 from 53Z to^76% from pre- to posttestlng. 

«^ in the earlier course delivery, pre- to posttest attitude scores 
increased. The increase shown during the earlier delivery, however, was , 
significant. In both groups pretest attitude scores were rather "high and 
the pretest score for the 1977 participants was even higher. This cou^d 
account for the lack of a signficiant difference from pre- -to posttest for 
the Sunuter 1977 group. ^ ' / ' . 
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<^ ^ 

Although several ^s^ts|of the course were generally rated between 
good and very good for th^«arl4er, delivery, they were rated somewhat higher 
overall for the Summer 1977 course ci^livery. This suggests that l^e■visions 
made in the course content and inaterials were appropriate' and well received. 

Conclusions 

The CEE course was tjffer^d for the secpndjtime during Summer, 1977. 
One hundred and nine students at nine AESP" sites and two Teacher Corps 
locations participated in the course. 

Cognitive achievement* increased sigrfificantly during the course. 

Attitudes, for the AES'P participants, A^hich were^^erally positive initially, 

\ . - / ■ .... 

did not change signficantly. However, the attitudes of the Norton Teacher 

Corps participants did increase significaiftly during the course. 

.4. 

r The vid^fitapes received significantly higher ratings at the AESP " 
sites where. programs were transmitted via satellite thanr^at^^ the Norton Teacher 
Corps site. Ratings by all participants however were above average. Like- 
wise, the ancillary activities received higher ratings at the A§SP sites. 
The seminars received above^avpfage ratings. The major criticism of the 
seminars was that the participants felt t>iat their questions were not 
answered in enougfj detail or directly enough. ' . ^ • - 

Site monitors received Jkhe htghest ratings compared to other components 
of the course, although all components were rated as good. The ratings 
overall were somewhat higher than for the course offered pr^iously. * 

In summary this delivery receiVed slightly higher overall ratifigs 
than the e?irl i er\del'iyery indicating that modifications in "course content 
aiS^activities were appropriate. - . • , 

■ .82 



SUMMARY AND CONCLUSIONS 



The. results of the'summative evaluation of two courses delfvered by * 



A£SP-during tMe Sp.rlng and Summer of 1977 have' been presented'iTi this report. 

- - ~ \ ■ • , ' ' 

This information can be used to validate the effectlvfeness of the courses , 

' • •'.-»*.' • 

>' ^ . - 

as well as to make revisions where indicated^ . ^ 

The subjects of this report consisted of 236 persons who completed one 
of two icourseSji, Diagnostic and Prescriptive Reading Instruction and, Career 
Education for Elementary Teachers. Results included' information on 
cbgnitive .and attitudinal achievement* as well as participants' reactions to 
the various' learning activities, and methods of presentation used during the 
courise. ^n addition, data on the, rel lability" of? the technical ^quipment ,^ 
used;was^nalyzed and '.the fesillts of the most current course delivery were 
^mpared to^- earlier deliveries. ^ , ^ ' ^ ' 

Overall, the ratings of all aspects of b(?^^oinrses were" above 
average. CE| received slightly^ higher ratings than previously suggesting 
that changes that had been made were effective. 'DPRI ratings were slightly . 
lower' than earlier deliveries and this was related to technical .diffi-culties 
in the brpadcarts. Participants' attitudes toward cour*se concepts were 
positive at the -beginning of both, courses. Even so attitudes improved, 
though not significantly so.^ Cognitive achievement iijcr^ased significantly 

frem tJre- to pos,ttest a3ministrat'ion for both courses. 

. - 

Site monitors? received the hig"hest ratings of lalV components for 
both courses which indicates that the monitor makes an important -con^nibu- 
'tibn' Jif' the effectiveness of fhe course. The most' Trequeiif suggestion' for ' 
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n 



imijrovement in b,(^th courses was .^hat information given be mone specific and 
that more concrete examples that laould be applied^feo the classroom be used*. 
\ ' In sunmary., both the.DPRI and CEE" courses &roadcast during 197*7 wer^ 

effective in achieving their cognitive objectives. Although 'attitudes did 

^ ' - • • • ■. ■ ' ' • 
not become significantly more positive, th^ relatively positive attitudes d4s^ 

played initially would make it difficult to'^chieve a significant increase. The 

various components of the -courses including videotaped televised programs, 

seminars, and ancillary learning activities*all received above average ^ 



ratings. These results are similar to those obtained following earlier - 
deliveries of the DPfff and CEE courses and tlius serve to, validate results 
obtained previously. 
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ICOMBINED AniTUDE AND BACKGROUND QUESTIONNAIRE FOR DPRI #14 



This questionnaire is divided into Z parts. The first part es concerned with 
your attitudes towards, reading, and the second part asks for some background 



infpmjatiorr. Please "answer as truthfully as possible. Your answers do not'/ 
affect your grade in the^urse,^ but also help us t% assess the affectiveness 
of the course and suggest ImjSrovements. " i - ' ■.. ^ 



Be sure you ha^ an Op-Scan form titled "General Purpose Answer Sheet." >lrite 
your naiM«on thfe upper left hand .comer bh the back of^the form., F^ill out the 
Special Codes and, Student .Number boxes as follows: ^ ^ 

• ^ / ■ • " 

|S BIIITHOATl SPECIAL CODES 



MO. I YN. 



im 



7 ^ 10 ir tt 13 « ir 

STUDENT NUMBER,. 



©0l©0®©#©#®J©©©(o)®©<o)©(o; 

©©.'©©•©©•©•®0©<5)0©©©©- 

M s®i©®kD©®©©©©@©©©©@0© 

.O®©I00®®®©®©®©©©®®©©© 
®®i®®0*©©©® ©©©©©©©©(«} 

F ®®J®®®®(»^®®®®®®®®®®®^ 

0000® ®®®®®®®®.®®®®®®® 

®®j®<!)b000©®®®®®®®0®® 

®®i®0 ®®®®®®®®®®®®®®® 

V TEST ®®®®®0|©~®®®^®®®® 1 sk, 
FORM , I I 

'A© IQ 

bQ 2© 

CQ 3® 

OQ *0 



in columns 1 - € fill in 140101 

in columns 7 lO.-fill in your 
four-digit student number. 



in cplumhll fill in the option 
yoi|fhave signed up for^ i.e.'* 



DO NOT WRITE 
IN THIS SPACE 



A© 



1 II III IV 

'0©©0 

t 



FR© 
SOPH©' 
JR© 

srO 

GRaD© 



.1 for K-3 

2 for 4-6 

3 for K-e 



Use a sdft-lead (#2).^encil to mark the Shswer sheet — do not use a pap 
ball-point. If you c/iange your mind or make a mistake, be sure that yoyt 



completely. Do n6t make any^other marks on the answer sheet. 



erase 



For each statement. in" the* first part mark-: 



5 
4 

.3 
2 
1 



I? 



-'^f you ^ron^ly agree with the statement . ,' 

- .If you modecately 'agree ' , . 

- If you feel j]eutral 

- ilf you moderately d^sagrge* . ^ •• . ^ ' 

- If yoii strongly disagpaer ' " , . . 

The second part of tfje questionnaire ask§ ■^'or background information.. The 
information obtained is potentially very helpful in conducting the course and 
in evaluating its 4jsefttlne?s. ' Please answer all questions on the form^tihl^ss 
a question does not apply jpr If you cannot remember the info»*nation asked, for. 
This informatiorlfjs kept bonfrdential. . . ^ ' - - ' 



if- 



Combined Attitude ,and Bacjj0whs( Questionnaire for D'PRI #14 P9ge 2 

I. One respafjs.ibility of the primary reading teacher is- t(^J^5)(fJ^5se students 
to difl^epent kinds of experiences ' - ^ ' '^ ' u ^ ■ 

• Z. Reading should be integrated With another classroom activfSes.' 

3* /Contjngenqy contractirig .is a method that lets cMldren "goof off" and not 
* make .good^je 6f their time in school.^ * * 

,4. There's nothing a teacher can do to develop 'reading readiness in Students./ 

5. Information systems link+ng dia^nosif and instruction are effe'ctive^ways 
to plan Instructional activities, ^ 

\ • . ' . ^ ^ , ' • ^ ^ . 

6, ^Students in your class should all, read the same thing, so no one feels bad/ 

*' • . ■ , • 

7\ Teachers only need to diagnose student needs in the fall of the year* ^ 

8. Informal tests are better than standcirdized' testsxfonplacing students at 
appropriate , levels. - * ^-r . \ y ' 

^ Prescriptive instruction is the best way to teach reading/ ^ 

l-O, A child should read all the way through every book she ta*es out of the 
library^ - ' • V * ' * 

IK Kindergarten teache^rs do not have to viorry abQut teacfhing students ^ 
understand *stories. ^ : ^ ^ ^ ' 

.12. If a qass is. largei»»there's no way ^to Work with .individuals. 

13. A third-grade te&cher. only nee^s thi^rd-grade instructional mateVlaIS;>^ ' .r'^ 

14. ^ Knowing how to understand a graph or table is an aspect of social studies 
' and not an aspect of rplding instruction • 

^15, A student is a good reader if he can read every 1«/ord correctly. 

16, Not using every page in the workbook' is* wasteful • ^ ' : . 

17* ScoresL^bn standardized /:ests provide 'adequ^ite information for instruction. 

18- If a ,child is' not interested in reading, th^e is little a t^eacher can do 
-* to generatfev enthusiasm. ^ . / ^ / • ' ' - 



,,19. ^Time spent diagnosing||ou]d be better sperit instructing.^ *^ 

20. If you don't have enough bookS for all your students, you cannot effectively 
use a se^ of niateH^ials. - • i . " . 

'"21. There is" so mych material Jto cover in school' that taking ^ijgfe ta.Tet • ' 

.chi'ldreh do "free reading**! is not productive. " . . ' V 
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• Combined Attitude and Background Questionnaire for. DPRI #14 
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Zt, Sex 



1. Hale • 

2. ■ F^lf' 




■ " ■/ 

23. OescKiption of, coninunity in wMch you. teach (br work in some tfther area 
./iin education) . ' >: , '• , ■ • 



2. SliSurban^ \ . 



3. Urban ■ . / " ' ' ' /' . / 

24, Age in years as of last .birthday 

r/' -21-30 * . • ' ■ 

* 2.- 31-.2iO , « . • ^ • 

3. 41-50 ■ - ^ ■ - ' # • 

. 4. '.51-60 . ' . - J, ^ 

5. 61 or over ' . 

'25. Score on GRE Verbal, (le^ve bl-ank^, yau>have -not taken it or do not 

• ■ remember -score) . - ' - - 

1. '. 400 or below * ' , . * - . ♦ 

401-450 ■ . ' ■• ' . 

" 3i 451-500 . . 
i4 . 501-550 . - .- 

5. '551 or above ' ^■y^ . \ : • • 

'26^. 'Score oi^ 6RE fluanti.tative (leave blink if you have not taken it or do .not 
V rfemember score) ' - , , ' 

* 1. • 400-'or b€low • ' • r. ' 

2. 401-450 * * • • • . 

3. -451-500 ■ i - .* 

4. 501.-550 ' • ' • \ ' - 

5. ' 551 or' above ' • , . ' 

jition during 1976-19.77 academric year • . / 

1. Classroom teacher . r ^ * ^ ^ -» 

2. Reading specialist ^ * . .: . 

3. Special education teacher ■ ' . . , • 

4. School administrative; position' ^ Jk.. * 

5. other . . t, • ' ' , < 

28. Choose the gra^e, range that clfisely approxiinates 'thg grades you work with 
. ,*1.' Elementary^ - alt grades • - 




Combined Attitude and Background Questionnaire for'DPRI #14 



29.. Work experience in teaching 

11 . fyear or less * 
. '•• 2. 2-4 years ' 

3. 5-8 years 

, 4. 9-15. years ' . - . , 

5.* 16 ye"ars or more , 

/ . . , ■ " ' • ' 

30. Experience as a Reading Specialist 

/ 1. ndne 
2. 1 year or less " . 

T 3. 2-3 years 

4. . 4-5 years • . 

^ V 5.- 6 years or more 



31., Are you taicing this course for credit? 



1. Yes 

2. - No' 



32. If you have registered for credit where would you like to obtain credit? 
(leave blank if not registered f&r credit) 

' " . '-',"■■•'»• / • 
1. University of Kentucky , • ■ 

2., Other College or University . ' ' 



■'I 



33, Last. degree, completed ' 

f. High School Diploma 

2* Baccalaureate ^ 

3* Master's ^v. 

,4. Specialist 

^l. Doctorate 



34. Number of undergraduate rea^ling courses the major emphasis^ of which was 
- reading instruction ^. Js ' 

4.3 • . ^ " ■ -. ^ V • . 

5. ^. or more 



, .35. Number of graduate reading courses the major emphasis of which was reading 
instruction ' " " " >i. . <^-- 



T.. none 
2. 1 • 
•3. 2 

5. ^ or more 



erIc 



So 



Combined Attitude arid Background Questionnaire for DPRI #14 
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36. If you are currently enrolled in^a colljege progHram.whieh of the fonowing' 
be st 'de scribes' your, purpose? / "-"^ - . 

1. Baccalaureate degree ' ' , , . 

.2. Master's degree or Doctorate ' C-v • 

3. JEnrotled in courses to maintain teaching certificate ' \ 
.4. Other ' ■ . * - ^ \ 



" Not enrol-led 



1 



V 




\ 




> 
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.Appalachian Education Satellite Program 

, ResoureeCoordiijating Center 
3Q2 Braal^y Rfll, University of ken;tucky - 
Lexington, Keatucky 40506 



INSTRUCTIONAL ACTIVITIES RATING FORM (lAR) #13 



r 



This questionnaire is composed of four parts. Part I rates the t^ped'TV programs. 
Part II rates the TV seminars. Part III rates the ancillary activities; and Part IV 
asks for an ove^a^ll rating of the amount' of useful itiformation you received from 
each type of instructfonal jnedium* Af\ additional blank .piece o'f paper if provided 
for -any comments, criticism, or suggestions; yoi/ may have for .course reyls^n. 

f^''^^ "'^i a'\^II*Lo/ this questionnaire deal.wlth your reactions to tbday's * - 

instructional ae^ivities.. Only fill out the parts- that correspond to today's • 

acttvi-ties,.e.g/ if you. saw a TV semirtar and dfd the ancillary activities, you ^"^ 
would^eomplete Parts II, III, and IV..' ■ .4 

Pleaise ansvW as truthfully as possible. Your answers do not af^ct your grade 
in the course, but help us to assess the effectiveness of the course. and suggest 
Improvements. ■' * . , 

Mark your ahsjtfers on the OP'SCAN sheet provided. Turn your OP'SCAN sheet so' that 
the special codea and student number boxes' are on your lower left. Fill out the 
special codes and student number boxes as indicated below:^ ' ^ ' •• 
,/ 2 3 " 5 ^.■'.^J /p. w i z i3 ?r . , ' ■ 



g BIKTH DATE 

^ ®®j®® 



©©)0©j®(|)©®0® 



©©:©© 



SPECIAL copes 



/ 



©© 



TEST 
FORM 

A©. -"Ol 
8© ?© 

•c© 



iM ®®i©q®©®©©0b?®©©0@*©00 

'©®©;®®i0^O00©0®O0000©0 
• ®®-0®0©000000t-O000000 

F ®®;©®0©.®0,00|0000©0j000 

.O©®®®®©®®©©j®0000®0®© 

' ®®!®®0®00®0(7)®000®0,®® 



STUPH/t; NUMBER - 

T 



©©©000000 
0®0®O00®0 



®©0®®d:' 



00 ©.^§0 



'•^0 



0®®000l00(^ 00000(?i 



00 N'^ Wf ITE 
IN THIS SPACE 

^0 I U III IV 

8(7 00©0 




FR© 

sophO 

JR-O 

gradO 



• in columns -1-2' fill in 13 ' • • ' . 

columns 4-4- fill "in the 
fdentifi cation number .for your course 
\ . r » ' ' 

*in tolijmns 5-6 ffll Ju. t-he*" class • * 
'session -ni&nber * . 

in*columns 7-10^ fill in y^r foun- 
digit student niJmber • . . 



;;l^djjie) pencil to mark^e anjwer -sheet — dp not. use' a pen or ball- 
!>ire your mark fills the^ntire btock of the response you wish to^ake- 
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0se i Si 

point. • Be^.-Sure your _ ^w- .„^..„.^. 

Youriferk should be heavy, black and 'stay within, the 'lines so that the machine-.can 
read your replies. If yoii chafige .yoOr mind or make a mistake^ be sure tha£ you 
erase completely. Do not make any other marks on, the answer sheet. 

' - • . .* • ■ ^ 

Turn the sheet so ,that the words "General Purpose Answer' Sheet" ahe on your upper 
left^ Begirt answering at the appropriate part for today's activities,' ie .'care- 
ful that the item number on the questibnnafre corresponds to th#nuitiber on tlhe 
OPSCANI sheet that you- are marking. * . . ^ ' . 

If any of the questions are not applicable, p.lease leave t'hose'.item's Hlankr 
*The sftft coordinator will provide you With these numbers. 



> 
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t . - - • ♦ ' ^ 

PART l'; ,Videotaped TV Proafam ' ■ 

In questions 1-5, rate t;^ese components of the TV program for their value in ht 
ing you untterstand the oVeraTl content of the.,progrin using thp f^lloWng scalf 



1 ^-e)iellent ' • , . , 

2" = very good 

3 goad ' > ' ^ ^ 

4 r fair ^ 

' 5 >poor : - , ■ * . 



.1.- The presenter's discussion of material was: ' 
« .■ • 

2. ' T.he class»»oom scene with the presenter describing activities Was- ' 

- • .• ' ' 

3. ,;Jhe presenter's explanati6n of the graphic materials, e.g. chan'sT, • 

diajgrams, _e,tc._jwas;__i_ • * , • • > , . - 

4. The scenes ofsA teacher working 'with students were: 
The interviews of experts or practitiar»rs v/ere: 



Rate the aspects of the unogran listed in questions ,6-8 for the amount of tifne 
you feel should have been, spent on these subjet^s wing the following ^scale: 

V= much more time . - - ^- ^ ' ^ 

2 = somewhat more time - i ' " ' \ 

'3 = coverage' was adequate ' . 

.4 = somewhat less, time / \ 
^ 5 - much less time - . ' ' I \ 

* ^ ' > . ^ ' --^ • " i ' 

.6. Discussion of the theoretical aspects of each t^c 

7. Discussion of procedures for using the materials , ' " 

8. Examples of the acttial application of the techniques in the classroom - 

9y The program might have ,been more effective if they had covered: 
J (It the pi^gram. coverage was adequate, mark option five),. 

■ ' , T) .le'ss material »but in greater depth ' * . 

2) less material * . • ^ , , 

3) 'more material' in less depth ^ ' 

4) more material relevant to the central issues of the 'topic ' ' 
" .5) progranrcoverage was, adequate ■ ■ ' 

10.* yhich of the* following might have.jnade'the presenter more accept^dle?^ 
• (If the presenter was. acceptable, tnark oction four.) • ' 

1). If he/she spoke more clearly . ' • 

' • 2j if" he/she appeared more knbWledgable about the subject area 
aSJ 'if he/she spoke, in. a more. natural manner 

•^^) ^he/she was quite acceptable. , 91 ' ' ' i ^ 



11. -The program might- have been easier to follov/ with: \ 

•1) more explicit transitions between 4 dea^s > . 

•2j more careful organization of/ content ' 

3j greater amplification of main points f ' 

* 4) more summary statements ; 

12.,[ What effect do you think the ii^^ormatlon contained ui the program will 
^> h.ave on your teaching? . ' ' ' ^ ' 

1) ' Has little" or no. relevance for me In my teaching situation 

2) /would like to use but probably wob't be able to ' 

3) would like to use but don't understand enough 

4) pUn to use ^ ' c * • . 
^ ' 5) already know or am using 

13. Graphic mater1qTs^(e.g*, tharts, books and other written materials) 
could have been used Iri the prograni> , , , ' 

^ 1 ) much more frequently « . , ' 

2) more frequently • ^ ' 

3) ^ use was satisfactory . . . * ^ 

4) . l^ss' frequently ^ ^ 

5) much less frequently * > 

14. Graphic materials needed to .be held on' the screen: 

- ^ , . . ' ^ . . / 

V) much longer ' . , ■ * ^ . 

2) somewhat longsr ' ^ . ^ ; 

. 3) tine was adequate, - - ' ' / ' j 

4) sorr.ewhat shorter f' ' • * 

5) much shorter / ^ ' ^ ' * ' 

15. The pace of the program should be: ' — |^ 

/ 1) much slov/er * . 

2) somewhat slov/er - ; ^ - • . , 

j 3) pace v/as ^satisfactory " f , , 

4) . some^hcit faster • • 

5) much faster y . 

16.. In generc^T, the clarity of the picture on the TV' set was: 

r r ' \ : ^ .• \ 

ly excellent V 

2) v'ery <30od ' 'a 

3) goo(t" , • ' . • ^ 

4) - fair - • , 
^5) poor . \ 

17. In general, -the quality of the, sound from the TV set was: 

* * * 

1) excellent , • , ^ 

2) very good ' ^ ' * * s ' / 
'3) good , • * . • 

-4) fair, ; r r ,9^ ^ . ' ' 

5) poor > ' ' t , 



v' ' lAR - page 4 ' ^ ^ • ' 

. 18. Tb^re'were annoying distractions in the room while viewing TV: 

1 ) Very often * * * 

2) ofteV \p ^ 

3) occasionally ' • ^ ^ 
. 4) rarely.^ ' - ^ . v . ^ 

5) never ' ' ' ^ ' ^ . 

79. What is your ovelrall, evaluation of the TV program: ' ^ , 

1) excellent <* ^ 

2) very good J ^ . 

3) good . ' 

4) fair • - - ^ 

• • '5) po\)r . ■ • . ' - 

20, Do you Kave specific co)^ents or suggestions regarding the TV program? ' 

- 1) yes - . ' ^ ^ 

Zy no - . ■ • 

If your answer is yes, write your conrwnts on the blank paper " 
provided. ■ 

■ PART II: Senin^tr 

21. Which pne of the following 'fomats would you select to make°the 
seminar format more effective? . ' * 
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«1) a pnp-hour televised seminar v/ith a 15 mintrte intermission so that 
questions can be qenerated and- transmitted ^ 

2) a two-hour sominar with^'everal 15 minute intermissions for 
qiiestion generation and transmission 

3) a one-hour televised seminar with the opportunity for Question 

/ generation durirw the program and J5 mnuies prior to Ihe program 

4) a one-hour televised seminar with dirrct voice line h^ok-u^^^ 

1 \ between individual sit*s and TV studio • • j • • 

^5). ot^er (please specify by^^writinq on th^ blank paper provided) 

. 2^. Which one ot the following* would have made today's seminar mor6 effective 
*• ^ (If the seminar participants were fine* mark option four) 

■ \ • 1) the moderator answering the questions himself without gu6sts 

2) use m.pre teachers as guests * ' • 

3) use more professors or other experts as guests - 
\ . * 4) . the .seminar particWnts were fine * » 

23. i/hich one of the^followipg Seminar formats might help >ou think of 
more meaningfuUquesti*)ns to ask? 

1) have at the beginning of yhe seminar a 10 minute summary of course 
■ qontent covered since the last seminar ' ' 

• ■ ' 93 . 
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2) ; show a ■ 10, minute film with short segment^ from previous programs 
- - at the beginning of the seminar 

3) show at the beginning of the seminar a short film illustrating , 
several new classroom demonstrations of material covered """'i 

4) ijave the opportunity ^o use the whole seminar for question answering 
and discussion rather than spending part of the program for question 
stimulation. - 

.5)^ther (please specify by writing on the blank paper provided) 

*24. The answers ito the questions could have been niore valuable if ther?* had 
been: ' { ' . . • 

Ij less dtscussion of theoretical aspects of the question 
2} more^frequent use of specific classroom example's 

'3) "more direct answers to the questions^ n . \ 

4) less repetition in the guests an-swers , 7 - ^ ' 

5) I^was very satisfied with the answers I heard 

23. ,The seminar moderator could have been more effective if he had: > 

1) kept the guests on the topic better ' 

2) .provided summaryV statements occasionally 

3) . allowed each guest equals time to respond td questions . , 

4) .kept the seminar moving at a' faster pace so more questions could be 
aoswefed . 

26* The fiim segments used during the^ interactive seminar as sources of 
stimulation for the 'serttinar discuss^ibhs were: 

\) extremely useful. 

2) very useful 

3) somewhat useful ^ J - ) 
.4) completely useless ^ 

5) not applicable v " / , . ^ ^ 

f?. If there was .not time to answeH your questions on the sejninar do you feel 
that the answer you will receive via teletype or VHF will h^seful? 

1) yes ^ * 

2) no ^ • 

'J 

28. Do you feel that answering questij)ns via teletype or VHF 1^ a service.^ 
that heed& to be continued? . , * . 

1) yes ■ . 

2) no . ; . i 

29; What -is your overall evaluation of today's seminar? r. 

t) • excellent • ^ ' *. . • 

2) very good 
■ 3) gotfd •• 

4) fair • ' 
__5)_poor , ^ . 94^^ ; ; 



lAR -"page 6 / 

30. Do you have specific comments. or suggestions about the seminar? 



yes 
no 



'If your answer was yes, write your comnentjon the blank.paper 
provided. - 



^ PART III; Ancillary Activities ' 



/ 



31. H6w oftJen did youjise materials from the reference shelf during lab? 

• 1) very often . * ■ - - 

2) often ' . ^ » 

• 3) occasionally 

4) rarely 

5) never 

32. How much time did you usually spend working on the ancillary activities 
duHng class? * . . . 

1) 30 minutes or less 

2; 45- minutes 

■ 3) 60 minutes 

4) 90 minutes * 

5) two hours or more 



\^ 33, The "ancillary activi^ties should haive covered: 

1) much jnore material 

2) somewhat mon^ material " ^ . - 

3) material covered was adequate ' C 
\ 4) somewhat less material 

5) much less material 

\ ^ ' ' *^ ' . ^ 

^ Rate questions "34-41 according-to the^llowing scaTe:^ • 

\ " ' ' , * 

1 ) strongly agree * ; ^ . i>c 

. / 2). moderately agree , . ' * 

3) no opinion or neutral ' ^ 

4) moderately disagree . 
^5) strongly ;diasgr^e 

34. Instructions for the. ancillary, activities were clear. ' - 
35* Ancillary activities were relevant to the TV program. 
3.6^,' Time allowed for completion of anciUary activities, was adeqi^e. 
37. Ancillary act,ivities were practical and applicable to the classroofr. 
' .38. too much reading. nrat^rial was assigned for class preparation.. 

ERjc . 95 
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39, Preparatory readings should have be&\ more relevant to the ancillary activities". 

40. The materials on the rerference shelf y/ere not relevant to the ancillary 
activities. - ' ^ 



.41. The assigned homework was quite useful. 



42. What is your overall evaluation of today's ancillary activities? 

1) excellent 

2) very good ^ 

3) \ good ^ y • , 
' 4) fair f " / ^ 
. 5) poor ^ . , ^ 

43. Did you feel there were any activities that werfe especially innovative 
op creative in today's session? - • . 

1) yes • ' . 

2) no - . 

If yes,fxiease identify those activities "on the blank paper provided. • 
44^. Do you have sfpecific cornments or. suggestions about tbe class session? 



D' yes . , 4 : 

2) no r . * 

If your answer was yes, write your comments on the blank paper ^ • 
provided. . ^ ^ 

. ^ . ^ Part IV: Feedback Questionnaire ' * 

Rate the following Sine .instructional activities according to the. quantity of. 
useful i nfo)yiati on yo^. received from each . as compared 'vnth a traditional • 
'^^^^ij]^ cpurse. ♦ " ' . 

1 = outstanding received a lot m^^^e-ffom the activity tha^you 

usually obtain from similar act fvi ties In a teacher 
P|:eparat^on course' "i 
"^'2 = good - r^^eTVed littlejpore from the activity - • ^ 

3 T average - receiv^ about ttfe same aipoiint ffony the activity • \ 

4 = poor - received somewhat less • ' - ' ' \ . 
' ^ 5 = unacce^tfiae :^ recisiyfid a'^lot^less iriformation from activity^ 



45. ;* Pre-proqram* preparation compared to work usually assigned , 

in other •cla$ses pnior to covering -material in class. . ' ' ^ 

46. Televised^ -Inte^active Seghinars compared to other seminars 
and clas§ diseuss4ons. ^ . * ■ \' • ^ 



/ 

T 1 
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48. Ancillary' activities' dompared tx? class activities associated with 
* other courses. - * ' . 



49, The videotaped TV programs compared to lectures ^usually associated 
with other courses. .L. ' . ' , 

,§0. - FoTlow-up activities and homework assignments compared to similar 
activities In other courses. . . • 

• * * . ~ 

51. On-site ref^ence materials Compared to materials pla^d on reserve by 
•ather instructors. ° 

52. The "site monitor as an effective course leader'. " 

:53. ^Do )'ou have any specific .comments or suggestions concerning these 
comparison? . > ^ ' 

1) yes. ' ■. . , . • 

2) no • 

i , ♦ 

. ^ If your answer was yes, write your, comments on the blank paper provfdedil 
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Appalachfan Education Satellite Project 
Resource Coordinating." Center 
Evaluation Comptfnent 
302 Bradley Hall ,;Uni vers ity of Kentucky 
Lexington, Kentucky. 40506 



fifiHBINED ATTITUDE AND BACKGROUND QUESTIONNAIRE FOR CEE #40 ' " 

-|. . / , ' . - 

This questionnaire ts divided into 2 parts. The first part i? concerned with 
your attitude toward Career Educatioji 'and the' second part asks for some background 
Hnfonnation, ^Pleasd answer as truthfully as possible. Your answers do nOt affect 
y^iir grade in the course, but'.help us to, assess the effe'ctiv£ness of the course 
aad suggest improvonents. / . ^ ' , 

Be sure you hive an Op-Scan form titted "General Purpose Answer Sheet," Write 
your name'on the upper ieftfiand cofiier on the back of the form. Fill out the 
•Special Codes and Student dumber jj'o'xes aS follows; / 

' ■ ,/ ■/ * /*_,• 



r 



BIRTH OATt 

< t 
MO. I VH» 



M 



®®i®(2) 

0®®;®(d5®< 
®®i®®i 
©©;©©( 



©©!®j£ 



Try : 

• foam" 



CO 



SPeCIAL COOFS 

L 



0 ©10© 12 

®©l©©©©©4)©« 

' "©©■(^©©©©(l 

®©<s 

ol©®«©©®©© 



®|®©©®©®©©®^ 
©©©©©©©©© 



®®®©©®®©©©©©®©© 
0®i^®|®(^©®® ©©©©©©©©© 
®®®®l®®©®®®®®® - 



T 



STUOe^NT NUMBER 



®®©©®@®©@®©® 

'©©©©©J®©©©©©©® 
00000000®® 

t!)®©©©©©©©©@ 

©®®©®©©©®©® 



DO NOT WRITE 
IN TH'S SPACE 



I d Ml IV 

oooo 



FvB© 
SOPH © 

JR© 
SR© 

gbadQ 



In coliSSnns 1-6 fill in 400401 

in columns, 7-10 fill in your 
four-digit student number 



Use ^ soft-lead pencil to mark the answer sheet —.do not use a pen or ball- 
pplrtt. If you change your mind or make a mistake, be sure tY^t ydu erase completely 
Do/not make any other marks, on the' answer sheet* - 

•or 'each statement \x\ the first part Jiiark: ' ^ * / * 



If you strongly agree with the statement 

if you moderately agr^ee 

if you -^f eel neutra.1 

if you .moderately disagree 

if you strongly disagree 



The second part af the quest'ionnairef^ asks for background information. The informati 
obtained Is potentially Very. helpful, in conducting the course and in evaluating its 
usefulness. .Please answer all questions on the fofiji unless a question does, not appl 
or if you cannot remember the information asked for. This Infonflation is kef)t ' 
cbnfldentlal. 
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• •<:oinbined Attitude and Background Questionnaire for CEE ^ ' , ^wgfe 2 

* . ♦ • 

1. The 'school program should include careec- development. ' 

- 2. Career education should be a continuous, life-long process. . : ' ' 

3. Information ^bout careers -should be .integfated with school curriculum. '. ' • ^ 
\. The conmunity is an excellent resource to use in. a career. education program. 

■ 5. I am^ willing to. take the* time to find feoimtUYiity Resources for a career education ' 
pr.ogram. . / • . ' 

6. jjeaching plans should be organized ^raund what people do in their occupations. 

7. I consider what f3^ople do ih.thfeir* occupations. when I organize my teaching plans. 

8. A commitment from the schoiv administration is' necessary fpr a successfirl^ career 
'education program. ^ ^4 . . • ' 

X' ' ' f ' ' ' ' ' ' * 

9. Schools have the responsibility to -help students develop career objectives. 

10. Students should have experiencfriin the world of work before leavjng school. 

11. The school curriculum should be re^Wted to the career goajs of the student. 

12. Parents should be aware of career education experiences occurring in tha school system 

' _ _ * . ' 

13. Helping children develop occupational awareness should be emphasized, from kinder- , 
garten through" grade $ix. ^ ^ . 

14. Children in elementary school are, too young to start thinking about tareer 
possibilities.^ 

15. The^^^ljssriJom teacher should be ^responsible for career education. 

16. * Career education is just another fad that will soon be forgotten. • , * 

17. ' 'Career education will help students make realistic careerv choices. 

/ 

18. ^ Students should be permitted to miss regular , classes i0 order to go on field trips'*. 

19. It is important for children to be taught a work ethie. 

"20. I feel that career education should be included in the curriculum experiences af 
each child. 



% 



2K A comitment from the classroom teacher is neejied fpr a successful career education 
program. ' • • * . / ' 

22. Subjept matter lesson plans should Include career information., 

23. ^ elementary teacher should know the cdmmunity ejnployn^ent needs. 

24. Enoujgh -empfiasis is arlready placed on career education in the schools. 

25. Career education in the'^ elementary school is futile. since a person wi^ change his 
c ^ mind several times before picking a lifetime career. . ' 
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26. ^ Sex 



/ 



. 1. Male 
2. Female 



» * « / * . * t 

27. Description of coninunity in which you teach (or_y/ork in some, other airea in educ&ti 

• 1 . ' Rural_l^ • * , - 

. 2.' Suburlrari ' . . - 
: 3. Urban , • • 

28. Age in years as of last birthday 

1 . 21 - '30 

2. /31 - 40 

3. ! 41 - 50 

' 4. (51 - 60 .. . - 

5. %^ or over 

29. Position during 1976-77 academic year 
* ^ • 

1. Classroom teacher . . 

2. Schoot Counselor 

3. Special education teacher .* ' ^ . ' • 
'4. School ac(ministrfitive position . 
5.. bther 

• : ■ ..; ^ • • 

Choose the grade range that closely approximates tfefe grades you work with , 



30. 



1. .Elementary all grades 

2. K 

3. -' 1 - 3 
4^. 4-6 
5. 7-12 



/ 



V 



31/ Work experience in teaching* 

1 . 1 year or less. 

2. '2-4 years ^ 

3. 5-8 years, 
■ 4. 9-15 years 

5. 16 years or more- V 

32. Wfrat was' your undergraduate grade-point'average? (convert to fpur^i^^flt; scale 
where A = 4) . ^ - - ^ * ' ^ / 



1. less than 2.50 

2. 2.51 - '2:75' 

3. 2.76 - 3.25 

4. ^ 3.26 - 3.50 • 

5. 3.ST - 4.00 



/ - 



1, .1 
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What was yoifr graduate grade- 
wHepe A * 4) 



1. 
2. 
3. 
4. 
5. 



less than 2.5a 
2.51 -2.75 
2.76 - 3.25 
3.26 - 3.50 I 
3.51 - 4.09 ■ 



34. tast. degree completed 



Hi^lOthQol Diploma 
Bac« laureate 
"^"ist'er's 
specialist 
Doctorate 



■erage? {conve'rt .for' f6ur-point scale ' 



[ 
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Career Education in^the Elementary School \ ^ ^ 

i 

Pleese Icfrcle tfie appropriate response and write your comments in the space provided. 

1. tW^ideQtape associated with this unit-provided useful information.. 

Strongly agree , l.\ 2 . * 3 '4 5 6 * 7 Strongly disagr'ee 



events: 



2. Th^ instructions tor tfie ancillary activities we're clear. 
^ Strongly agree M 2.3^ 4 5 6 7 
Comments : r 



Strongly disagree 



3. wAdequate time was allowed to complete the ancillary activities. 



Strongly agree f 1 



7 . Strongly disagree 



Comments: (How much tine did you^spend doing the activities? How much time 
did you need to complete the activities?) 



4\ The 'ancillary activities" were practical and applicable to the classroom. 

Strongly agree 1 ^^ 2 3 4 6 .7/ Strongly. disagree 

Comme^Kts: (What are ttfe strengths and weaknesses of the ancillary activities?) 



5\ Overall today's activities were 

Very good ' 1*2 34 
Gomnients: 



5 6 7 



Very. bad 
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Nam^: 



Agency J 



AppalacTrfan EdDcation Satellite 'Program 
Resource Coordinating Center 
Evaluation ^Componen^t. 
3fD2 Bradley Hall, University of Kentucky 
Lexington, Kentucky 40506 
J ■ 

SUMMATIVE REPORT FOR^^(SRF) #08 

' 1 Course: ' ^ - 

- > ' ' SUe(s): - 



Instructions . ' . ^. 

Rate the overall quality of the following activities, in each af the four 
categories.. Complete ^one SRF for each course yoi* consulted for opmonitored. 
Using the following S-^point sca>e: ^ - ' ' 

1 - generally excellent in that category 

2 - excellent at times v . % 

3 - acceptable 

4 - weak at timefe * - ' ^ • ^ 

5 - generally unacceptable ^ - - 

* 

Place a number in each box- * * , • 





Overall 
Rating 


Cont^t 


Quality 
of Pre- 
seht?ition 


Student 
Reacftion 


Relation to 
other Unit 
Activities 


Televised Lecture. 













1. 



" • \ I - 

Cpriinent on your ratings and suggest improvements in the materials and procedures 



• * 

♦ 


.Overa:ll 
Rating 


Content 


Quality 
of Pre- 
senilation 


'Student 
Reaction' 


Ration to 
other Unit 
Activities 


4-Channel Audio Review 








1 • 


• 



2. 



Comment on your ratings and suggest improvements in the,mater1als and procedures. 



SRF - 











Quality 




Relation to 






Overall 


Content 


of Pre- 


Student 


.other Unft 




1 


Rating 




sentation 


Reaction 


Activiti.es ' 


3. 


TeTevised Seminars 













Conment on your ratings and suggest improvements in the materials arW procedures 



< 1 


Overall 
Rating 


Content 


Quality 
of Pre-t 
sentation 


Student 
* Reaction 


Relation to 
other JLInit 
Activities 


Ancillary Activities 













Comment on your ratings and suggest improvements in the matisrials and procedures; 
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Please circle the appropriate response: 

1. The equipment is easy t9 use 

2. I likfed 'operating the equipment ^ 
3.. The equipment check is easy to do 

4. The Equipment Report and Student 
Satisfaction ''instrument is eas'y to use 

5. Equipment repair service was satisfactory 

VHF J ' 

ATS-6 reception system 
' Teletype system ' ^- ■ 
Telecop.ier 



Strongly agree 
1 ■ 2 
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1 

,1 

A 

1 
1 

1 

1 



2 
2 



2 
2 
2 
2 



- Strongly 
3 4 



3 

,3 
3 
3 



4 
4 



4 
4 
4 
4 



disagree 
5 



.5 
5 
5 
5 



Appalachian Education S^telUte Project 

Resource Coordinating- Center 
302 Bradley Hall, University of Kentucky 
. f I^^JcTngton, Kentucky 4050S ' 

SEMINAR EVALUATION #45 

The foUowIng questions are designed to assess your rea.ct1ons' to today's seminar. 
Your^ responses do not affect yo,ur grade in the course but they do assist us In 
improving future seminar deliveries. Please circle the response that most closely 
represents your r6action to today's seminar. 

1. Which one' of the following would have made today's seminar more effective? 
(If the se'mlna'r participants were fine, mark option four) 

. , * - » 

1) the moderator answering the questions himself without gues't^ 

2) use more teachers as guests ( 

3) use more professors or other experts as guests 

4) the seminar partjicipants were fine 

2. Which one of the following seminar formats might help you think of more tiieanlng- 
fuT questions to ask? 

1) have at the beginning, of the seminar a 10 minute summary of course content 
covered since the last segilnar - 4 

2) show at the beginning oftheierainar a short film illustrating several 
new classroom demonstrations />f material covered ' • 

3) have the opportunity to use fhe whole Seminar for question answering and 
discussion rather than spending part 6f the program for question stimulation 

4) the seminar format was fine 

5) other (please* specify by writing on the back'^of this page) , . 

3. The answers to the questions could have been more .valuable if there had been: 

1) less discussion of theoretical aspects of the question 

2) TOre frequent oise of specific. classroom exampT^s 

3) more direct answers to the questfdns . 

4) less repetition in .the guests answers 

5) I was very satisfied with the answers I heard 

4* The pace of the seminar should be: 

1) much slower ^ ^ 

2) somewhat slower 



3j the pace was satisfactory / 

4 ) somewheft faster / - 

5) much faster / 



5. The seminar moderator could have been more effective if he/she had: 

1) kept the guests dn topic better 

2) provided summary" statements occasionally 

3) kept the semtnar mqving at a faster pace so more questions could be answered 

4) . asked guests to give more detailed answers ^ 

5) the moderator was acceptable as is ^ , » 
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eact to the^fonowing statement; ^ The seminars gave me an opportunity to have 
reat, input. 



1) strongly agree 

2) moderately agree 

3) neutral 

4) moderately disagree 

5) strongly disagree 
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React to the following statement: The interactions in the seminar were of 
. personal relevance to me.> ^ 

^ ^ \ 

1) strongly agree ) 

2) moderately agree 

3) neutral 

4) moderately disagree 

5) strongly disagree 

8i What is your overall evaluation of today's seminar? ^ 

1) excellent 

2) very good 
•*3) good 

4 fair 
5) poor 



If you have Other comments on the 
of this page. Please be as specifi 
about the seminar. 



S'Mtli 



nar, please write your conments on the back 
: as possible about the strengths -and weaknesses 
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Appalachian Education Satellite Programs 
Resourc.e Coordinating Center 
Evaluation Component 
. 302 Bradley Hall, University of Kentucky 
Lexington, Kentucky 40506 

EQUIPMENT REPORT AND STUDENT SATISFACTION FORM (ERSS) #09 



A 



Pipogram # 

Local Time: starting 



Site # 



2_ 



Date 



ending 



If you have^had any •equ.ipment* problems during this program, please describe thdT 
problem as specifically ds possible and note any action taken.- ' 



If tl)e problem involves any of the following pieces of equipment please complete 
the Equipment Trouble Log ; television set, video tape recorder, teletype, DAA 
Interface, telephone line, or cable system. 

Did the above-mentioned problem result in an impaij?mei\t of service during the ' 
progAm? Yes No . If yes, please exjyTain: 



The following items refer to the above program number (complete all that apply) 

HP Receiver signal strength Azimuth reading ; 

Elevation, re a t i i n g ' ' " ' 

Please circle the appropriate response using the criteria outlined in the Site 
(:oordi*nator's Manual: Remember to use tfie correct sequence in colums 



one and two as described in the manual. 



Audio Siqnal 
TV Audio 

1 1 

2 2 

3 3 

go ■ 

no go 

ATS-6 Syst^ 
operat^e * 

inoperative 



Channel 1 

1 1. 

2 2 

3 3 
: go 

no go 



4-Channel Audio Signal- 



Channel 2 

1 1 

2 2 

3 3 

^ go 

no go 



Channel 3 

1 • V 

2 2 

3 3 • 

go 

no go 

r , 



Video Signal ' 



i07 



ChanAel 4 


TV 


Video 


1 1' 


1 


9 

1 


^ 2 


2 


2 


3 3 


3 


3 


: go- 


4 


4 


no go 


5 


5 






go 






no go 
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Audio Signal v Temperature 
VHP 



T 1 . ^ Weather ' Clouds -Wind Snow Ice 

"2 • 2 ' , ' • Litt}e/none, J 

■33'. ' Moderate , . ' _^ : 

qo . • Heavy . ■ > 

no qo ' 



Miscellaneous Problems (Check all that apply) 

*There was a delay tn program broadcast 

Low attendance. State probable reason 



Cancellation or po5tgonement*of class. State probable reason 



Missing ancillary materials , ' 

Missing evaluation materials 

student Satisfaction:' " , ' • * — 

Taped Program* ' 'Live Senriinar Ancillary Activities 

excellent excellent excellent 

very {jood very good , very^good 

good good , ^good 

fair^ - fair * , " fair 

poor poor , poor 

For Seminar Days only 

1. How many questions were sent in from your site? " • 

2. Did you transmit questions individually as they were genera*bed : or in 

groups 1 (Check appropriate category) If questions were grouped, what , 

was the usual number of questions, in a group?- - 



For Ancillary Sites: • • 

.3. How many times were you interrupted by busy signal when -attempting to 

transmit questions to the main site? ' ^ ■ - ^ 

4; How long''did' it, take to transmit the questions to the main site?^j: 



lo the space below and on. the back write-the reactions Ind suggestions made by 
the students about today's activities. Include any 'suggestions, special problems 
or requests that you might have. Also, wfite student numbers of absent students 
on back. ' ' 
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Appalachian Education Satellite Programs 
Resource Coordinating Center 
Evaluatjon Component 
3Q2 Bradley Hali; University of Kentucky 
Lexington, Kentucl^y ^506 - . 



EQUIPMENT REPORT ANIfSTUOENT SATISFACTIOfti 



P^gram # 



Site i 



Date 




,SS)-#09 



Local Time: stxirtiiig 



ending ' 



If you have had any equipment problems 'during this pro'gram, pi easei describe tffe 
prtblem as specifically as possible and note' any. action taken. „ 



If the problem involves arty of the fonowing pieces of equipmehl pjease coniplete 
the Equipment Trouble log : television Set, video tape recorder, teletype, DAA 
interface, telephone line, or cable system. ^ 

Did the above-ijientioned problem result in an impairment of service during the 
program? Yes No- . If yes, "pfea5e explain: ' 



The following items Vefer to the above, pragram, number (cbmp'lete all that apply) 

HP R6cejver signal strength Azimuth reading 

Elevation reading . ' , 

Please cifcle the appropriate response usingithe criteria putlirted In the Site' . 
Coordinator's Manual; Remember to use the correct sequence .in column 
"one '"and twg^^s? described ,in the manual. ^. , -s^ • 

Audio Signal 
TV.AuditD 

2 2 

3 • • 3 

go- ' 



^ no go 

\f ATS-6 System 
I operative 

inoperative ' 
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4-Channel Audio Signal 




Channel 1 


Channel 2 . 


Channel 3 


Channel 4 


1 ^ r 


V I 


1. 1 


' I 1\ 


2 . • 2 ; 


2 2 


.2 2 


2 2 


%, 3' 3'. 


3 3 


3 3. 


3 '3 


.^go 
^ no go 






JO 


._ no- go 


■ Jio go 


no go 



Video Signal 
TV Video 

1 '1 

2 2 
, 3 « 3 

4 4 ■ 

5 5 

— go'% 

no.go • 
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t ' • ■ • 

iSktdio Signal ^ Temperature 



^HF 



I 




1 1- .Weather ' Clou/ls . Wind -Snow- Ice 

2 2' Lit'tle/none' 

3 3 . ' " Moderatg 
go • Heavy 



no go 



- Miscellaneous Problems (Check all that apply.) ' 
. There was a delay in proaram' broadcast 



Low attendance. S^ate probable' reason* \ ; 

Cancellation or postponement of class. State probpible reason jv, ^ 



Missing ancillary materials <' 
Missing evatuatidhNmaterials 



Student Satisfaction: 




Taped Program . Live-Sgrainar Ancillary Activities 

excellent __ excellent " excellent^ 

• very good very good very good 

. . good " ' good • good 

^ fair •- fair fair 

' poor poor . poor 

For Seminar Days only 

1. How many questions were sent in from your site? 

2. Did you transmit questions individually as they were' generated or .In ' 
groups 1 (Check appropriate category) If questions were grouped, what 

' was- the usual "number of questions in a group? ^ 

For Ancillary Sites: . ' • 

3. How many times were you interrupted by a busy signal when attempting to 
transmit questions to the main site? ■ . ^ 

4. How long did, it take to transmit the questions to the^main sil^? ^ 



In the space below and on the back write the reactions ^ind suggestions made, by 
the students about' today's activities. Include any suggestions, speciay proble 

,or requests that you might have. Also, write student number.s of abseny student 

'on back. 
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. . CAREER EDUCATION SUMMARY 'EVALUATIOM iA 

The purpose of this InstrumerJt is to assess your overall reaction to the Caf-eer ' 
Education course you have just ^mpleted. ' ^ 

Hate the following six .items according to' the quantity of useful Information 
you received from each as. compared with a traditional Instructor-taught course. 

• > " " , ' 

1 = outstanding *- recefved a lot more^from the actfv^ty than you usually 

obtain'.from similar activities In a teacher preparation course 

2 = good- - received a li.ttle more from the activity 

3 = average - received about the same-amount from the activity 

4 = poor - received somewhat t^ss . ' . 

5 = unacceptable - recelvfedj^ToTies^^nfonnatlon from the actlvlt^^.t - . 

1. f re-program preiparatlqn compared to work usually assigned fn other classes 
prior' to covering, material .in class. , -, , . - • 

2. Televlsed.^lnteractlye semln^rs^ compared 'to other seminars^ and class discussions. 

3. Ancillary activities compared to class activij:1es associated with other courses. 

4. The 'Videotaped TV programs compared to lectures usually associated with other 
. courses. ■ ' - . , ■ • . 

5. Follow-up, Mtivities and homework assignments comparred to similar activtties ^ ' 

• in other courses. . \ ^ , ^ " ' . • • . 

6. The site monitor as an effective course leader. ' ^ 

♦ * t 

1. Do you have any specific comments or suggestions concerning these comparisons? 

# 

1) yes ■ . 

. 2) -no . * . . * • ./ 

• ■ ■ ■ ' - . ' ' 

If your answer was yes, write your comments on the back of this page. 



o 



Please react to the following -statements: 

8. I did not feel that the technolpgy employed in the delivery of thi^s coyrs^e 
,made it an impersonal experience. ' 

1) strongly agree ' • . . 

2) moderately agree 

3) neutral . • • . , ' 

4) moderately disagree ' 
5j strongly disagree 



If you have^any suggestions for making the course more personal, please 'write 
ErJc ^^"'^ poimients on the- back of this page. * : 
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1 • A 

•9. It wo^uld have been very difficult for me to get the information that was" 
-provided in/ this course in any other way. 

}) strongly agree [* 

*2) moder^ely agree 

3) neutn 

4) mo'derately disagree 
•5) stroagly disagree , ^ . 

** ' / ' 4 ' . * 

^ Please' comment on your alternatives in terms of distance from other educational 
/ institu/tions^or otiher xiifficul ties you might have encountered. 

10. The textbgok ft)r this course, was an ijiteresting and Informative supplement to 
the videotaped' progr^mis and ancillary activities. 

1) strongly* agree ' , ■ . > 

2) inoderateJy agree. . ' 
3} /neutral 

5) /. strongly disagree 

•-/ 

.'11. Tj^e coutjse presented m^ny interesting ideas and techniques for practical, 
)pli cation In the classroom. 



4) / mocjeratel^ disagree^ * % 



strpngly^gree, , • ^ . ^ ^ ^ ' 

'^2) moderately agtee * ' r ' ' ' ^ * 

3) neutral 

/^4) moderately disagree ^ ' ^ 

5) strongly disagree I— ^ " - - * 

J2. What effect do you think information contained in this coursfe will have (Jn. 

your teaching? ^ ^ . - ^ 

, ^""^^^ > * ♦ ' ' ' . ' , 

1) has little or no relevance for me in my teaching situajfeion * 
\^ 2) would like to use but probably Wbim be able to / 

3) ^ would like to iise but don't understand enough > 
■ -4) plan to. use ' , \ - 

5) .already know or am^ using . ^ * ' ^ • 

/ • ' ^ 1 - 

13. The 5uidelines I follo^ In completing the anciHary materials were: 

« • ' • - * * • 

1) Clear apd easy- to-follpw / ^ 
^ 2) Gerterally understandable - > , ^ , • . 

• • . 3) .Somewhat confusing; * } 

4) Very difficult to,fo*llow ^ ^ • ' 

14. 'Wou^ld^^yoU*^be. Interested in participating in programs df this type in the future? 

2) ho ' ^ , 
If yes, please list those ar^as in whidh you would'like to see future pre sen tat i 



ERjc 1^ , . •■ ■• liz 
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AESP plans to continue. to offer courses iii teacher education to'the Appalachian ' 
region. In order to best respond to^ the needs of- teachers, we would appreciate \ 
your responding to the following question^: , . '^'^ ^ 

15< What is^the prim&ry reas.on for your enrollment in this €ot^nse? K ' 

1 ) needed the three-hours credi t /' * T . . • " - 

2) . interested In career education / ' ^ ' ' 

3) career edudati on mandate • . , ' , 

4) /other (please specify) " ' . \ ^ • 



16; In taking teacher education coursies, which of the followi/g course formats 
■do you prefer? i - ( , • / ' 

ij a three-crejit hour courle such as this 

2) a short <:ourse with one-hour credit 

3) a one-day in-servfce workshop 

4) other (please specify) 



17, In taking a three-credit hour course durfing the school year, do vou prefer 
to meet: ' ^ ^ ^ ^ , 

' ' . . • 

1) once a week for four months 

2) twice a week for two months 

3) more than twice a week 

4) other (please specify) 
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"The work upon which this publication -is based was 'performed pursuant to 
Contract #76-100C0-30O9A-76-C2-OE-O226 with the Appalachian Regional Commission 
under a prime contract between the ARC and the Technical Applications Division 
of the National Institute of Education, Departifient of Health, Education and 
Welfare." "Views' expressed in this publication are the v1e\Vs-of the Contractor 
.and not thoSe of HEW,* 



